2024-09-16T03:27:26.239 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T03:27:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T03:27:26.463 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892 branch: squid description: rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7905892' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 700 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - client.0 seed: 5616 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 15927/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKdLxA0Lp32RbMVphUNP8EMBayAOQXkGi120cc/yWZLAX6QKGp0W7JDGWxQLuDhMFsRV+vxPICam1ZjF6al2/Ss= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCB397NM97aFi0U0c/JpRXYRjOsnf2hckaUktT2vHifvvG4Fp33AQ8hyqX3/zNUDTXHssTXwSpbliskfB5vpcAs= tasks: - install: null - ceph: log-ignorelist: - missing primary copy of - objects unfound and apparently lost - had a read error - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) - \(PG_DEGRADED\) - \(OSD_TOO_MANY_REPAIRS\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - full_sequential: - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33 - sudo ceph osd pool create test 16 16 - sudo ceph osd pool set test size 3 - sudo ceph pg dump pgs --format=json-pretty - radosbench: clients: - client.0 create_pool: false objectsize: 1048576 pool: test time: 360 type: rand - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T03:27:26.463 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T03:27:26.464 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T03:27:26.464 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T03:27:26.465 INFO:teuthology.task.internal:Checking packages... 2024-09-16T03:27:26.487 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T03:27:26.487 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T03:27:26.487 INFO:teuthology.packaging:ref: None 2024-09-16T03:27:26.487 INFO:teuthology.packaging:tag: None 2024-09-16T03:27:26.487 INFO:teuthology.packaging:branch: squid 2024-09-16T03:27:26.487 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:27:26.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-16T03:27:26.682 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:27:26.683 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T03:27:26.690 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T03:27:26.690 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T03:27:26.698 INFO:teuthology.task.internal:Saving configuration 2024-09-16T03:27:26.710 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T03:27:26.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T03:27:26.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:21:51.868080', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPmM1+1PISBtaKmb9DwfJPEGmP57ZqrDfn/H3ZAWoSBN'} 2024-09-16T03:27:26.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:21:51.867109', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKj4vOPGtYhxzi1CqZzvz0/gE30JMuDrviAFgHHYeJz+'} 2024-09-16T03:27:26.763 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T03:27:26.770 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2024-09-16T03:27:26.770 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-16T03:27:26.770 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T03:27:26.833 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5d95bb6e60>, signals=[15]) 2024-09-16T03:27:26.833 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T03:27:26.840 INFO:teuthology.task.internal:Opening connections... 2024-09-16T03:27:26.841 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:27:26.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:27:26.923 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:27:26.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:27:27.003 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T03:27:27.009 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-16T03:27:27.014 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-16T03:27:27.014 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-16T03:27:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:27:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-09-16T03:27:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-09-16T03:27:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:27:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:27:27.063 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:27:27.064 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-16T03:27:27.092 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-16T03:27:27.098 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-16T03:27:27.098 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-16T03:27:27.144 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:27:27.145 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:27:27.146 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-16T03:27:27.184 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T03:27:27.195 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T03:27:27.204 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T03:27:27.204 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:27:27.207 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:27:27.211 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T03:27:27.246 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T03:27:27.246 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:27:27.251 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:27:27.270 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T03:27:27.324 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T03:27:27.339 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T03:27:27.340 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.3': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T03:27:27.340 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:27:27.340 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:27:27.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:27:27.345 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-16T03:27:27.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:27:27.346 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-16T03:27:27.391 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-09-16T03:27:27.391 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-09-16T03:27:27.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-16T03:27:27.393 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-09-16T03:27:27.393 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-09-16T03:27:27.393 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-16T03:27:27.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T03:27:27.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-16T03:27:27.629 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:27:27.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:27:27.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:27:27.701 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:27:27.800 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:27:27.800 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:27:27.858 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:27:27.861 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:27:27.930 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:27:27.936 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:27:27.967 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:27:27.969 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:27:27.970 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:27:27.990 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:27:27.991 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:27:27.994 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:27:27.994 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:27:27.997 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:27:27.999 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:27:28.005 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:27:28.040 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:27:28.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:27:28.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:27:28.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:27:28.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:27:28.041 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:27:28.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:27:28.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:27:28.045 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:27:28.069 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:27:28.071 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:27:28.071 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:27:28.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:27:28.083 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:27:28.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:27:28.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:27:28.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:27:28.086 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:27:28.094 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:27:28.094 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:27:28.095 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:27:28.108 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:27:28.109 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:27:28.109 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:27:28.109 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:27:28.110 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:27:28.111 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:27:28.213 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:27:28.234 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:27:28.351 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:27:28.529 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:27:28.545 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:27:28.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:27:28.704 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:27:28.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:27:28.715 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:27:28.718 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:27:28.718 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:27:28.720 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:27:28.788 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:27:28.800 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:27:28.801 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:27:28.891 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:27:28.892 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:27:28.892 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:27:28.892 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:27:28.899 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:27:28.907 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:27:28.910 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:27:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:27:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:27:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:27:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:27:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:27:28.933 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:27:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:27:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:27:28.947 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:27:28.947 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:27:28.948 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:27:29.013 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:27:29.014 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:27:29.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:27:29.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:27:29.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:27:29.029 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:27:29.030 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:27:29.030 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:27:34.343 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 16.0 MB in 2s (7,522 kB/s) 2024-09-16T03:27:35.005 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 16.0 MB in 3s (5,806 kB/s) 2024-09-16T03:27:35.765 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:27:35.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:27:35.844 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:27:36.051 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T03:27:36.051 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T03:27:36.228 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:27:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:27:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:27:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:27:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:27:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-09-16T03:27:36.229 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:27:36.230 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-16T03:27:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:27:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:27:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:27:36.232 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-16T03:27:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:27:36.232 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-16T03:27:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-09-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:27:36.285 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-16T03:27:36.285 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:27:36.463 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:27:36.463 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:27:36.464 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-09-16T03:27:36.464 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:27:36.464 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:27:36.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:27:36.543 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:27:36.753 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-16T03:27:36.754 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-16T03:27:36.932 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:27:36.933 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:27:36.933 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:27:36.933 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:27:36.933 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:27:36.934 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-09-16T03:27:36.934 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:27:36.935 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-16T03:27:36.935 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:27:36.935 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:27:36.935 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:27:36.936 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-16T03:27:36.937 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:27:36.937 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-16T03:27:36.937 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-09-16T03:27:36.990 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-16T03:27:36.990 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:27:36.990 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:27:36.991 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:27:36.991 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-09-16T03:27:36.992 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:27:37.172 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:27:37.172 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-09-16T03:27:37.173 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:27:37.173 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:27:37.964 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:27:38.313 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:27:38.559 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:27:38.908 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:27:40.544 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:27:40.544 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:27:40.544 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:27:40.888 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:27:40.966 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:27:41.124 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:27:41.125 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:27:41.125 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:27:41.359 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-09-16T03:27:41.463 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:27:41.537 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:27:41.544 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:27:41.959 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-16T03:27:42.119 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:27:43.552 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:27:43.556 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:43.635 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:44.180 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:27:44.184 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:44.316 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:45.754 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:27:45.775 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:45.862 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:46.307 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:27:46.327 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:46.357 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:46.542 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:27:46.563 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:46.648 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:47.145 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:27:47.166 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:27:47.203 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:27:53.161 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:27:53.312 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:27:53.654 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:27:53.765 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:27:54.052 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:27:54.075 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:27:54.119 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:27:54.295 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:27:54.447 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:27:54.780 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:27:54.934 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:27:55.237 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:27:55.247 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:27:55.287 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:28:00.071 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:28:00.109 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:28:00.146 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:01.077 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:28:01.114 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:28:01.151 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:02.718 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:28:02.841 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:28:03.183 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:28:04.115 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:04.264 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:28:04.392 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:05.594 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:28:05.707 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:28:05.720 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:05.720 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:05.720 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:05.720 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:05.870 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:06.116 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:28:06.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:28:06.533 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:07.254 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:07.859 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:07.860 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:07.860 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:07.860 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:08.029 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:08.656 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:28:08.765 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:28:08.875 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:08.939 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:28:08.939 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:09.438 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:11.056 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:28:11.199 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:28:11.329 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:28:11.400 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:28:11.400 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:23.314 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:28:23.314 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:28:23.327 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:28:23.352 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-09-16T03:28:23.675 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:23.688 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:24.061 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:24.067 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:24.137 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:28:24.143 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:28:24.311 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:28:24.312 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:28:24.312 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:28:24.348 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-09-16T03:28:24.806 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-16T03:28:24.824 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-16T03:28:24.824 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-16T03:28:24.824 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.121.121 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:28:24.825 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-16T03:28:24.826 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-16T03:28:24.826 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:28:24.826 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-16T03:28:24.826 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:28:24.826 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:28:24.826 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:28:24.826 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T03:28:24.826 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:28:24.827 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-16T03:28:24.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T03:28:25.211 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:28:25.221 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:28:25.303 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:28:25.384 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:28:25.707 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:28:25.707 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:28:25.727 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:28:25.737 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-09-16T03:28:26.069 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:26.101 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:26.485 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:26.490 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:26.555 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:28:26.561 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:28:26.582 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:28:26.600 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:28:26.654 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:28:26.720 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:28:26.720 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:28:26.720 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:28:26.774 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-09-16T03:28:26.840 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T03:28:26.841 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:28:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:28:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:28:27.014 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:28:27.053 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:28:27.055 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-16T03:28:27.112 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-16T03:28:27.112 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-16T03:28:27.112 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.121.121 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:28:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-16T03:28:27.114 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-16T03:28:27.157 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.JSOIB4FSKY 2024-09-16T03:28:27.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JSOIB4FSKY 2024-09-16T03:28:27.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.JSOIB4FSKY 2024-09-16T03:28:27.246 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:28:27.268 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.121.121 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:28:27.269 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-16T03:28:27.269 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:28:27.269 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:28:27.270 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:28:27.270 INFO:teuthology.task.kernel:Installing distro kernel on osd.3... 2024-09-16T03:28:27.270 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:28:27.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-16T03:28:27.336 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.JSOIB4FSKY is 10KB 2024-09-16T03:28:27.350 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.JSOIB4FSKY 2024-09-16T03:28:27.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:28:27.409 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:28:27.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:28:27.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:28:27.433 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-16T03:28:27.477 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:28:27.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-09-16T03:28:27.678 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:28:27.678 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:28:27.751 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:28:27.832 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:28:28.776 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:28:28.777 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:28:28.780 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-16T03:28:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:29.045 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:29.115 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:28:29.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:28:29.195 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:28:29.323 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:28:29.378 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:28:29.405 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-16T03:28:29.406 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-16T03:28:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:28:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:28:29.518 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:28:29.530 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-16T03:28:29.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-16T03:28:29.583 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:28:29.583 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:28:29.583 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:28:29.583 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:28:29.583 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:28:29.584 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:28:29.584 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:28:29.584 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:28:29.622 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:28:29.624 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-16T03:28:29.640 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-16T03:28:29.640 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-16T03:28:29.640 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-16T03:28:29.640 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.121.121 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-16T03:28:29.641 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:28:29.642 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-16T03:28:29.642 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-16T03:28:29.687 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.s4m1eQM3ym 2024-09-16T03:28:29.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.s4m1eQM3ym 2024-09-16T03:28:29.741 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.s4m1eQM3ym 2024-09-16T03:28:29.855 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.s4m1eQM3ym is 10KB 2024-09-16T03:28:29.867 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.s4m1eQM3ym 2024-09-16T03:28:29.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:28:29.926 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:28:29.926 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:28:29.926 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:28:30.004 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:28:30.005 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-09-16T03:28:31.370 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:28:31.371 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:28:31.373 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-16T03:28:31.553 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:28:31.558 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:28:31.786 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:28:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:28:31.831 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:28:31.835 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:28:31.969 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:28:31.969 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:28:31.969 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:28:31.986 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-16T03:28:32.005 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-16T03:28:59.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T03:28:59.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:28:59.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:29:02.009 INFO:teuthology.task.kernel:Checking client osd.3 for new kernel version... 2024-09-16T03:29:02.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:29:02.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:29:17.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T03:29:20.449 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-16T03:29:26.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:29:26.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:29:29.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:29:29.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:29:29.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T03:29:32.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-16T03:29:41.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:29:41.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:29:44.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:29:44.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:30:00.385 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T03:30:02.945 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-16T03:30:15.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:30:15.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:30:15.617 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-16T03:30:16.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:30:16.232 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-16T03:30:16.232 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-16T03:30:16.280 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-121-generic 2024-09-16T03:30:16.280 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:30:16.280 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:30:16.280 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:30:17.281 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T03:30:17.281 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:30:17.341 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-16T03:30:17.361 DEBUG:teuthology.parallel:result is None 2024-09-16T03:30:17.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:30:17.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:30:18.166 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-16T03:30:18.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:30:18.782 INFO:teuthology.task.kernel:Checking kernel version of osd.3, want "5.15.0-121-generic"... 2024-09-16T03:30:18.783 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-16T03:30:18.830 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-121-generic 2024-09-16T03:30:18.831 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:30:18.831 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:30:18.831 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:30:19.832 INFO:teuthology.task.kernel:Enabling kdb on osd.3... 2024-09-16T03:30:19.833 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:30:20.211 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-16T03:30:20.233 DEBUG:teuthology.parallel:result is None 2024-09-16T03:30:20.233 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T03:30:20.240 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T03:30:20.240 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:30:20.243 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:30:20.249 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T03:30:20.255 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T03:30:20.263 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T03:30:20.263 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:30:20.292 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:30:20.401 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T03:30:20.410 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T03:30:20.411 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:30:20.413 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:30:20.432 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:30:20.435 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:30:20.440 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:30:20.443 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:30:20.445 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T03:30:20.452 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T03:30:20.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:30:20.485 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:30:20.499 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T03:30:20.512 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T03:30:20.512 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:30:20.541 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:30:20.546 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:30:20.592 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:30:20.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:30:20.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:30:20.704 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:30:20.711 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:30:20.759 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:30:20.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:30:20.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-16T03:30:20.835 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-16T03:30:20.904 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T03:30:20.912 INFO:teuthology.task.internal:Starting timer... 2024-09-16T03:30:20.912 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T03:30:20.924 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T03:30:20.933 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-09-16T03:30:20.934 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-09-16T03:30:20.934 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T03:30:20.934 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T03:30:20.934 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T03:30:20.934 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T03:30:20.943 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T03:30:20.946 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T03:30:21.125 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T03:30:21.136 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T03:30:21.137 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T03:37:54.284 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-09-16T03:37:54.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:37:54.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:37:54.369 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-16T03:37:54.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T03:37:54.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:37:54.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:37:54.523 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-16T03:37:54.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-16T03:37:54.605 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T03:37:54.618 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T03:37:54.618 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T03:37:54.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:37:54.621 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T03:37:54.621 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Command line: ntpd -gq 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: ---------------------------------------------------- 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-16T03:37:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: ---------------------------------------------------- 2024-09-16T03:37:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: proto: precision = 0.062 usec (-24) 2024-09-16T03:37:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: basedate set to 2022-02-04 2024-09-16T03:37:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-16T03:37:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:37:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:37:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:37:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-09-16T03:37:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:37:54 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-16T03:37:54.674 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T03:37:54.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Command line: ntpd -gq 2024-09-16T03:37:54.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: ---------------------------------------------------- 2024-09-16T03:37:54.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T03:37:54.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T03:37:54.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: corporation. Support and training for ntp-4 are 2024-09-16T03:37:54.676 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: available at https://www.nwtime.org/support 2024-09-16T03:37:54.676 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: ---------------------------------------------------- 2024-09-16T03:37:54.676 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: proto: precision = 0.047 usec (-24) 2024-09-16T03:37:54.676 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: basedate set to 2022-02-04 2024-09-16T03:37:54.676 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: gps base set to 2022-02-06 (week 2196) 2024-09-16T03:37:54.677 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:37:54.677 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:37:54.677 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:37:54.677 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:37:54.678 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T03:37:54.678 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T03:37:54.678 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T03:37:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-09-16T03:37:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen normally on 4 lo [::1]:123 2024-09-16T03:37:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-09-16T03:37:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:37:54 ntpd[18529]: Listening on routing socket on fd #22 for interface updates 2024-09-16T03:37:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:55 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:55 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:56 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:57.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:57 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:58.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:37:58 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:58.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:58.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:58.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:58.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:58 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:59.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:59.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:37:59.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:37:59.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:37:59.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:37:59.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:37:59 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:00.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:00 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:00.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:00.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:00.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:00.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:00 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:01.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:01.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:01 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 03:38:02 ntpd[18487]: ntpd: time slew -0.002052 s 2024-09-16T03:38:02.650 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.002052s 2024-09-16T03:38:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T03:38:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 03:38:02 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T03:38:02.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:02.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:02.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:02.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:02 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:02.704 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T03:38:02.704 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-16T03:38:02.704 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:02.704 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:02.705 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:02.705 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:03.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:03.674 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stdout:16 Sep 03:38:03 ntpd[18529]: ntpd: time slew -0.001465 s 2024-09-16T03:38:03.675 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.001465s 2024-09-16T03:38:03.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T03:38:03.676 INFO:teuthology.orchestra.run.smithi138.stderr:16 Sep 03:38:03 ntpd[18529]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T03:38:03.730 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T03:38:03.731 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-16T03:38:03.731 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:03.731 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:03.731 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:03.731 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:38:03.732 INFO:teuthology.run_tasks:Running task install... 2024-09-16T03:38:03.741 DEBUG:teuthology.task.install:project ceph 2024-09-16T03:38:03.741 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T03:38:03.741 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T03:38:03.742 INFO:teuthology.task.install:Using flavor: default 2024-09-16T03:38:03.747 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T03:38:03.747 INFO:teuthology.task.install:extra packages: [] 2024-09-16T03:38:03.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-09-16T03:38:03.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-09-16T03:38:03.813 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T03:38:03.836 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T03:38:03.843 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T03:38:03.843 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T03:38:03.843 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T03:38:03.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:38:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T03:38:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T03:38:03.866 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T03:38:03.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:38:03.985 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T03:38:03.986 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:38:04.018 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T03:38:04.018 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:38:04.095 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:38:04.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T03:38:04.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T03:38:04.135 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:38:04.135 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T03:38:04.149 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-16T03:38:04.278 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:38:04.288 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:38:04.305 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:38:04.318 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:38:04.318 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:38:04.328 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:38:04.333 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T03:38:04.345 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:38:04.358 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T03:38:04.373 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T03:38:04.377 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T03:38:04.397 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T03:38:04.398 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T03:38:04.404 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:38:04.418 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T03:38:04.424 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T03:38:04.439 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T03:38:04.466 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T03:38:04.633 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 29.0 kB in 0s (85.4 kB/s) 2024-09-16T03:38:04.660 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.0 kB in 0s (87.5 kB/s) 2024-09-16T03:38:05.650 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:38:05.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:38:05.677 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:38:05.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:38:05.722 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-16T03:38:05.756 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T03:38:05.907 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-16T03:38:05.908 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-16T03:38:05.966 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T03:38:05.967 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T03:38:06.090 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:38:06.091 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:38:06.092 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-16T03:38:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T03:38:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T03:38:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T03:38:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T03:38:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T03:38:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T03:38:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T03:38:06.097 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-16T03:38:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-09-16T03:38:06.163 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:38:06.163 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:38:06.163 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:38:06.163 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:38:06.164 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:38:06.164 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:38:06.164 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T03:38:06.166 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T03:38:06.167 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet zip 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T03:38:06.168 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T03:38:06.169 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T03:38:06.169 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T03:38:06.169 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-16T03:38:06.169 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-09-16T03:38:06.200 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T03:38:06.201 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T03:38:06.202 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T03:38:06.203 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T03:38:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T03:38:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T03:38:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T03:38:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T03:38:06.331 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T03:38:06.331 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 181 MB of archives. 2024-09-16T03:38:06.332 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T03:38:06.332 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T03:38:06.344 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T03:38:06.344 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 181 MB of archives. 2024-09-16T03:38:06.344 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T03:38:06.344 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T03:38:06.389 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T03:38:06.415 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T03:38:06.419 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T03:38:06.421 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T03:38:06.438 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T03:38:06.496 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T03:38:06.501 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T03:38:06.513 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T03:38:06.517 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T03:38:06.518 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T03:38:06.519 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T03:38:06.527 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T03:38:06.530 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T03:38:06.532 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T03:38:06.533 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T03:38:06.533 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T03:38:06.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T03:38:06.536 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T03:38:06.551 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T03:38:06.553 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T03:38:06.553 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T03:38:06.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T03:38:06.555 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T03:38:06.555 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T03:38:06.555 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T03:38:06.556 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T03:38:06.568 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T03:38:06.569 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T03:38:06.585 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T03:38:06.588 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T03:38:06.588 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T03:38:06.589 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T03:38:06.589 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T03:38:06.590 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T03:38:06.591 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T03:38:06.591 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T03:38:06.602 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T03:38:06.603 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T03:38:06.607 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T03:38:06.619 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T03:38:06.620 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T03:38:06.625 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T03:38:06.625 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T03:38:06.625 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T03:38:06.626 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T03:38:06.626 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T03:38:06.627 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T03:38:06.627 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T03:38:06.629 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T03:38:06.629 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T03:38:06.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T03:38:06.631 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T03:38:06.636 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T03:38:06.637 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T03:38:06.638 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T03:38:06.654 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T03:38:06.654 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T03:38:06.655 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T03:38:06.657 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T03:38:06.682 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T03:38:06.709 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T03:38:06.710 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T03:38:06.711 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T03:38:06.711 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T03:38:06.712 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T03:38:06.729 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T03:38:06.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T03:38:06.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T03:38:06.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T03:38:06.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T03:38:06.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T03:38:06.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T03:38:06.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T03:38:06.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T03:38:06.761 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T03:38:06.762 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T03:38:06.765 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T03:38:06.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T03:38:06.780 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T03:38:06.781 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T03:38:06.784 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T03:38:06.784 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T03:38:06.786 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T03:38:06.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T03:38:06.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T03:38:06.796 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T03:38:06.797 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T03:38:06.799 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T03:38:06.811 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T03:38:06.813 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T03:38:06.813 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T03:38:06.814 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T03:38:06.815 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T03:38:06.816 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T03:38:06.819 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T03:38:06.821 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T03:38:06.822 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T03:38:06.822 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T03:38:06.824 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T03:38:06.829 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T03:38:06.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T03:38:06.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T03:38:06.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T03:38:06.839 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T03:38:06.846 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T03:38:06.848 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T03:38:06.851 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T03:38:06.853 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T03:38:06.860 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T03:38:06.905 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T03:38:07.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T03:38:07.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T03:38:07.092 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T03:38:07.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T03:38:07.144 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T03:38:07.173 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T03:38:07.182 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T03:38:07.183 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T03:38:07.184 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T03:38:07.202 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T03:38:07.207 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T03:38:07.211 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T03:38:07.216 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T03:38:07.295 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T03:38:07.300 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T03:38:07.304 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T03:38:07.307 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T03:38:07.309 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T03:38:07.309 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T03:38:07.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T03:38:07.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T03:38:07.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T03:38:07.378 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T03:38:07.395 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T03:38:07.396 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T03:38:07.396 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T03:38:07.402 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T03:38:07.403 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T03:38:07.460 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T03:38:07.460 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T03:38:07.462 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T03:38:07.463 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T03:38:07.541 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T03:38:07.543 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T03:38:07.545 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T03:38:07.546 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T03:38:07.556 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T03:38:07.622 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T03:38:07.623 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T03:38:07.624 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T03:38:07.627 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T03:38:07.631 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T03:38:07.703 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T03:38:07.752 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T03:38:07.753 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T03:38:07.844 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T03:38:07.845 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T03:38:07.845 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T03:38:07.846 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T03:38:07.851 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T03:38:07.926 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T03:38:07.929 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T03:38:07.932 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T03:38:07.956 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T03:38:07.977 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T03:38:07.997 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T03:38:07.998 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T03:38:08.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T03:38:08.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T03:38:08.003 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T03:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T03:38:08.057 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T03:38:08.057 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T03:38:08.069 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T03:38:08.073 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T03:38:08.075 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T03:38:08.130 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T03:38:08.130 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T03:38:08.130 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T03:38:08.162 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T03:38:08.162 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T03:38:08.164 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T03:38:08.164 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T03:38:08.166 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T03:38:08.166 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T03:38:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T03:38:08.175 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T03:38:08.244 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T03:38:08.247 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T03:38:08.249 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T03:38:08.326 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T03:38:08.332 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T03:38:08.334 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T03:38:08.335 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T03:38:08.346 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T03:38:08.347 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T03:38:08.348 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T03:38:08.355 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T03:38:08.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T03:38:08.408 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T03:38:08.409 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T03:38:08.489 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T03:38:08.490 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T03:38:08.507 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T03:38:08.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T03:38:08.509 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T03:38:08.514 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T03:38:08.515 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T03:38:08.982 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T03:38:08.982 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T03:38:08.997 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T03:38:09.032 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T03:38:09.042 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T03:38:09.043 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T03:38:09.104 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T03:38:09.194 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T03:38:09.195 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T03:38:09.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T03:38:09.254 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T03:38:09.264 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T03:38:09.286 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T03:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T03:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T03:38:09.359 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T03:38:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T03:38:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T03:38:11.170 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T03:38:11.173 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T03:38:11.174 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T03:38:11.473 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T03:38:11.507 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T03:38:11.510 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T03:38:11.511 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T03:38:11.700 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T03:38:12.049 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 181 MB in 5s (34.4 MB/s) 2024-09-16T03:38:12.233 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T03:38:12.267 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 181 MB in 5s (33.4 MB/s) 2024-09-16T03:38:12.334 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T03:38:12.340 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T03:38:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:38:12.430 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T03:38:12.530 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T03:38:12.536 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T03:38:12.629 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:38:12.769 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T03:38:12.795 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T03:38:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:38:12.966 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T03:38:12.992 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T03:38:13.033 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:38:13.171 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T03:38:13.198 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T03:38:13.238 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:38:13.328 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T03:38:13.354 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T03:38:13.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:38:13.616 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T03:38:13.643 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:13.683 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:13.798 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T03:38:13.824 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:13.872 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T03:38:14.129 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:14.169 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:14.285 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T03:38:14.311 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:14.351 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:14.531 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T03:38:14.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:14.597 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:14.662 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T03:38:14.680 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:38:14.721 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:38:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T03:38:14.935 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T03:38:15.034 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:38:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T03:38:15.100 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T03:38:15.141 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:38:15.353 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-09-16T03:38:15.380 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:15.420 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:15.486 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-09-16T03:38:15.511 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:15.552 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:15.881 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-09-16T03:38:15.908 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:15.947 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:15.955 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-09-16T03:38:15.970 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:16.005 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:16.408 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T03:38:16.417 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T03:38:16.434 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:16.444 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:16.474 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:16.483 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:16.760 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-09-16T03:38:16.761 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-09-16T03:38:16.786 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:16.787 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:16.819 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:16.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:17.114 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T03:38:17.130 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T03:38:17.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:17.156 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:17.180 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:17.196 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:17.424 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T03:38:17.433 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T03:38:17.439 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:17.448 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:17.478 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:17.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:17.935 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T03:38:17.961 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:18.001 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:18.002 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T03:38:18.029 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:18.069 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:18.330 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T03:38:18.356 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T03:38:18.388 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T03:38:18.396 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:38:18.415 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T03:38:18.455 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:38:18.716 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T03:38:18.733 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T03:38:18.742 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T03:38:18.759 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T03:38:18.782 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T03:38:18.791 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T03:38:19.018 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T03:38:19.033 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:19.052 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T03:38:19.068 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:19.068 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:19.110 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:19.414 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T03:38:19.440 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T03:38:19.463 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T03:38:19.480 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:38:19.490 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T03:38:19.530 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:38:19.758 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T03:38:19.773 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T03:38:19.808 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:38:19.815 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T03:38:19.831 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T03:38:19.874 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:38:20.069 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T03:38:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T03:38:20.127 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:38:20.177 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T03:38:20.192 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T03:38:20.227 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:38:20.464 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua5.1. 2024-09-16T03:38:20.490 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T03:38:20.531 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:38:20.589 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-09-16T03:38:20.615 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T03:38:20.655 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:38:20.834 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-any. 2024-09-16T03:38:20.860 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T03:38:20.900 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T03:38:20.975 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-09-16T03:38:21.001 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T03:38:21.041 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T03:38:21.119 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zip. 2024-09-16T03:38:21.134 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T03:38:21.169 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T03:38:21.263 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-09-16T03:38:21.278 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T03:38:21.321 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package unzip. 2024-09-16T03:38:21.507 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T03:38:21.548 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:38:21.633 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-09-16T03:38:21.660 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T03:38:21.700 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:38:21.952 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package luarocks. 2024-09-16T03:38:21.979 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T03:38:22.019 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:38:22.105 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-09-16T03:38:22.132 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T03:38:22.171 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:38:22.402 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-09-16T03:38:22.428 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:22.468 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:22.555 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-09-16T03:38:22.582 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:22.622 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:23.105 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T03:38:23.122 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:23.162 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:23.491 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T03:38:23.517 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T03:38:23.557 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:38:23.559 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T03:38:23.574 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:23.617 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:23.869 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T03:38:23.895 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:23.921 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T03:38:23.935 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:23.947 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T03:38:23.979 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:38:24.292 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T03:38:24.317 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-09-16T03:38:24.357 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:24.381 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:24.439 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:24.795 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-09-16T03:38:24.821 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:24.870 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:25.794 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-09-16T03:38:25.820 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:25.869 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:26.351 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-09-16T03:38:26.377 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:26.427 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:26.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T03:38:26.500 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T03:38:26.540 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:38:26.843 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T03:38:26.869 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T03:38:26.909 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:38:27.039 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T03:38:27.066 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T03:38:27.106 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:38:27.254 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T03:38:27.281 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T03:38:27.321 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:38:27.409 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T03:38:27.435 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T03:38:27.476 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:38:27.624 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T03:38:27.650 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T03:38:27.690 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:38:27.771 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T03:38:27.787 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T03:38:27.821 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:38:28.018 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T03:38:28.045 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T03:38:28.085 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:38:28.116 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T03:38:28.142 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T03:38:28.184 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:38:28.388 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T03:38:28.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T03:38:28.454 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T03:38:28.724 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-09-16T03:38:28.727 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T03:38:28.739 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T03:38:28.754 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T03:38:28.782 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T03:38:28.794 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:38:29.085 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T03:38:29.089 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T03:38:29.111 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T03:38:29.116 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T03:38:29.152 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T03:38:29.156 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T03:38:29.455 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T03:38:29.459 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-09-16T03:38:29.481 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T03:38:29.486 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T03:38:29.521 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:38:29.526 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T03:38:29.850 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T03:38:29.877 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T03:38:29.879 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T03:38:29.906 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T03:38:29.908 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T03:38:29.937 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T03:38:30.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T03:38:30.248 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T03:38:30.268 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T03:38:30.286 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T03:38:30.308 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:38:30.590 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T03:38:30.616 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T03:38:30.629 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T03:38:30.655 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T03:38:30.656 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:38:30.687 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T03:38:30.959 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-09-16T03:38:30.965 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T03:38:30.985 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T03:38:30.992 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T03:38:31.026 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:38:31.032 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T03:38:31.321 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T03:38:31.335 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T03:38:31.347 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T03:38:31.362 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T03:38:31.379 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:38:31.402 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:38:31.674 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T03:38:31.680 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-09-16T03:38:31.700 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T03:38:31.707 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T03:38:31.740 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:38:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:38:32.042 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T03:38:32.051 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-09-16T03:38:32.069 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T03:38:32.078 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T03:38:32.101 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:38:32.118 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:38:32.412 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T03:38:32.439 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T03:38:32.446 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T03:38:32.472 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T03:38:32.479 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:38:32.507 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:38:32.799 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T03:38:32.807 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-09-16T03:38:32.826 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T03:38:32.834 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T03:38:32.866 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:38:32.874 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:38:33.227 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T03:38:33.243 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T03:38:33.279 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:38:33.417 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-09-16T03:38:33.444 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T03:38:33.585 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:38:33.589 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T03:38:33.615 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T03:38:33.672 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:38:33.905 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T03:38:33.920 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T03:38:33.963 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:38:33.975 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-09-16T03:38:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T03:38:34.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:38:34.266 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T03:38:34.293 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T03:38:34.333 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:38:34.354 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T03:38:34.381 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T03:38:34.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:38:34.636 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T03:38:34.651 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T03:38:34.686 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T03:38:34.734 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T03:38:34.759 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T03:38:34.799 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:38:34.964 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T03:38:34.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T03:38:35.039 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:38:35.086 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T03:38:35.113 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T03:38:35.144 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T03:38:35.378 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T03:38:35.404 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T03:38:35.444 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T03:38:35.456 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T03:38:35.483 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T03:38:35.523 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:38:35.764 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-09-16T03:38:35.790 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T03:38:35.830 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:38:35.879 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T03:38:35.905 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T03:38:35.945 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T03:38:36.150 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T03:38:36.176 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T03:38:36.217 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:38:36.265 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-09-16T03:38:36.292 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T03:38:36.332 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:38:36.545 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-09-16T03:38:36.573 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T03:38:36.611 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:38:36.635 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T03:38:36.662 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T03:38:36.720 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:38:36.892 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T03:38:36.907 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T03:38:36.950 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:38:37.031 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-09-16T03:38:37.057 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T03:38:37.097 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:38:37.203 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T03:38:37.218 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:37.253 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:37.359 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T03:38:37.375 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T03:38:37.409 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:38:37.616 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T03:38:37.642 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:37.682 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:37.730 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T03:38:37.756 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:37.796 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:37.994 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T03:38:38.020 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T03:38:38.060 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:38:38.185 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T03:38:38.212 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:38.252 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:38.338 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T03:38:38.364 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T03:38:38.404 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T03:38:38.572 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T03:38:38.599 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T03:38:38.638 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:38:39.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T03:38:39.135 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T03:38:39.175 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T03:38:39.487 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T03:38:39.514 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:39.525 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T03:38:39.551 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:39.591 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:39.970 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:39.986 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T03:38:40.013 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:40.052 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:40.639 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T03:38:40.666 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:40.705 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:40.791 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T03:38:40.818 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:40.866 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:41.453 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T03:38:41.481 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:41.520 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:41.759 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-09-16T03:38:41.786 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:41.825 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:42.145 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T03:38:42.171 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:42.211 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:42.556 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T03:38:42.582 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-09-16T03:38:42.583 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:42.609 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:42.622 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:42.648 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:42.918 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T03:38:42.946 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:42.985 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:43.017 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-09-16T03:38:43.044 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:43.084 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:43.331 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T03:38:43.358 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:43.395 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T03:38:43.397 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:43.421 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T03:38:43.461 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T03:38:43.792 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-09-16T03:38:43.819 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:43.858 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:43.922 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T03:38:43.938 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:38:43.972 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:38:44.154 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T03:38:44.181 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T03:38:44.220 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T03:38:44.540 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T03:38:44.556 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:38:44.598 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:38:44.986 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-09-16T03:38:45.013 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:38:45.052 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:38:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T03:38:45.398 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T03:38:45.438 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:38:45.646 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-09-16T03:38:45.673 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:38:45.704 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:38:45.758 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T03:38:45.785 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:45.824 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:45.991 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T03:38:46.018 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T03:38:46.057 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:38:46.161 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T03:38:46.188 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T03:38:46.227 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T03:38:46.361 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T03:38:46.388 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:46.427 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:46.530 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-09-16T03:38:46.557 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T03:38:46.597 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:38:46.731 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T03:38:46.755 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T03:38:46.790 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T03:38:46.933 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T03:38:46.960 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:47.000 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:47.118 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-09-16T03:38:47.145 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T03:38:47.184 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:38:47.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T03:38:47.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:47.596 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:48.246 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T03:38:48.262 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T03:38:48.296 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:38:48.767 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T03:38:48.793 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T03:38:48.833 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:38:48.919 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T03:38:48.947 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T03:38:48.985 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:38:49.186 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T03:38:49.214 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T03:38:49.253 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:38:49.515 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T03:38:49.542 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T03:38:49.555 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T03:38:49.581 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:38:49.582 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T03:38:49.622 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:38:49.935 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T03:38:49.963 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T03:38:50.002 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:38:50.288 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T03:38:50.314 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T03:38:50.316 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T03:38:50.341 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:50.363 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:38:50.466 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:51.065 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T03:38:51.093 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:51.226 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:51.386 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T03:38:51.413 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T03:38:51.452 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T03:38:51.755 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T03:38:51.782 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T03:38:51.821 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:38:52.158 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T03:38:52.185 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T03:38:52.197 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T03:38:52.225 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T03:38:52.225 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:38:52.263 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T03:38:52.536 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T03:38:52.552 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T03:38:52.567 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T03:38:52.594 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T03:38:52.595 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T03:38:52.633 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:38:52.915 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T03:38:52.942 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T03:38:52.971 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T03:38:52.981 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T03:38:52.998 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T03:38:53.037 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:38:53.276 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T03:38:53.303 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T03:38:53.334 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:38:53.366 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T03:38:53.394 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T03:38:53.432 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T03:38:53.645 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T03:38:53.673 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T03:38:53.712 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T03:38:53.820 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T03:38:53.848 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T03:38:53.895 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T03:38:54.024 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T03:38:54.051 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T03:38:54.175 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:38:54.441 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T03:38:54.469 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T03:38:54.508 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:38:54.828 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T03:38:54.856 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T03:38:54.903 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T03:38:54.929 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T03:38:54.945 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:54.987 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:55.274 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T03:38:55.301 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T03:38:55.306 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T03:38:55.334 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T03:38:55.348 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:38:55.373 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:38:55.643 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T03:38:55.671 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:38:55.701 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:38:55.945 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-09-16T03:38:55.973 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:38:56.012 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T03:38:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T03:38:56.043 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:56.088 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:56.264 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-09-16T03:38:56.281 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T03:38:56.323 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:38:56.400 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T03:38:56.427 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T03:38:56.466 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:38:56.634 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T03:38:56.662 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T03:38:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:38:56.786 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T03:38:56.814 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:38:56.853 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:38:57.063 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-09-16T03:38:57.079 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:57.121 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:57.124 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-09-16T03:38:57.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:38:57.205 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T03:38:57.461 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-09-16T03:38:57.477 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T03:38:57.519 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:38:57.798 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T03:38:57.813 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T03:38:57.847 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:38:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-09-16T03:38:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:58.269 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:59.509 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T03:38:59.537 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:38:59.576 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:38:59.863 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T03:38:59.879 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:38:59.921 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:00.232 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T03:39:00.260 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T03:39:00.298 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:39:00.586 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T03:39:00.614 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T03:39:00.644 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:39:00.717 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T03:39:00.744 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T03:39:00.783 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:01.015 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T03:39:01.043 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T03:39:01.062 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T03:39:01.078 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:39:01.081 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:39:01.121 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:01.415 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T03:39:01.432 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T03:39:01.465 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:39:01.478 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pkg-config. 2024-09-16T03:39:01.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T03:39:01.536 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:39:01.789 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T03:39:01.804 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T03:39:01.805 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T03:39:01.832 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T03:39:01.847 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:39:01.870 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:39:02.234 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T03:39:02.234 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T03:39:02.261 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T03:39:02.261 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T03:39:02.300 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:39:02.300 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T03:39:02.603 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T03:39:02.630 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T03:39:02.669 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T03:39:02.698 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-09-16T03:39:02.726 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T03:39:02.764 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:39:02.990 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T03:39:03.017 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T03:39:03.026 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T03:39:03.042 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T03:39:03.056 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:39:03.084 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:39:03.368 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T03:39:03.395 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T03:39:03.434 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T03:39:03.496 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T03:39:03.524 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T03:39:03.562 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T03:39:03.712 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-09-16T03:39:03.740 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T03:39:03.778 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T03:39:03.866 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T03:39:03.893 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T03:39:03.932 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T03:39:04.074 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T03:39:04.101 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T03:39:04.140 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:39:04.412 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T03:39:04.439 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T03:39:04.469 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:39:04.619 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T03:39:04.647 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T03:39:04.685 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:39:04.765 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T03:39:04.793 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T03:39:04.832 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T03:39:04.988 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-09-16T03:39:05.016 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T03:39:05.054 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T03:39:05.177 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-09-16T03:39:05.204 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T03:39:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T03:39:05.357 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T03:39:05.385 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T03:39:05.424 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:39:05.589 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T03:39:05.617 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T03:39:05.655 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:39:05.761 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T03:39:05.789 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T03:39:05.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:39:06.105 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T03:39:06.121 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T03:39:06.143 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T03:39:06.163 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:39:06.171 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T03:39:06.210 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:39:06.513 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-09-16T03:39:06.541 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T03:39:06.579 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T03:39:06.800 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-09-16T03:39:06.828 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:39:06.883 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T03:39:06.883 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:06.911 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T03:39:06.949 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:39:07.304 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T03:39:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T03:39:07.370 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:39:07.640 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T03:39:07.662 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T03:39:07.668 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T03:39:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:39:07.706 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:39:07.728 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:08.041 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T03:39:08.299 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:39:08.417 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:39:08.470 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-09-16T03:39:08.498 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:39:08.536 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T03:39:08.995 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T03:39:09.365 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T03:39:09.392 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T03:39:09.403 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T03:39:09.431 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:09.802 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T03:39:10.187 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:39:10.268 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-09-16T03:39:10.314 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:39:10.391 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:39:10.576 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T03:39:10.685 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:39:10.893 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T03:39:10.944 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:39:11.046 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:39:11.297 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T03:39:11.338 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T03:39:11.415 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:11.556 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:39:11.682 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T03:39:11.908 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-09-16T03:39:11.984 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:39:12.065 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:39:12.341 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:39:12.344 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T03:39:12.576 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:39:12.603 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T03:39:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:39:12.863 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:39:12.954 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T03:39:13.106 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:39:13.213 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:39:13.339 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T03:39:13.357 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:39:13.608 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:39:13.633 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:13.986 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T03:39:14.185 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:39:14.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T03:39:14.311 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:39:14.437 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:39:14.505 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:39:14.586 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:39:14.757 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:39:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:39:15.008 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:39:15.239 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T03:39:15.251 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:39:15.278 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T03:39:15.325 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:39:15.443 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T03:39:15.502 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:15.762 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:39:15.803 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:39:15.888 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:39:15.912 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T03:39:16.014 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:39:16.141 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:39:16.163 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:39:16.400 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:39:16.431 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:39:16.749 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T03:39:16.777 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T03:39:16.799 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T03:39:16.864 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:39:16.866 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:39:16.989 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T03:39:17.348 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:39:17.450 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T03:39:17.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:39:17.735 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:39:17.795 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:39:17.913 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:39:18.002 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:39:18.304 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T03:39:18.322 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T03:39:18.430 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:39:18.715 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T03:39:18.958 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:39:19.082 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:39:19.318 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:39:19.326 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:39:19.452 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:39:19.578 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:39:19.603 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:39:19.871 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T03:39:19.946 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:39:20.180 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:39:20.272 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T03:39:20.306 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:20.515 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:39:20.607 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:39:20.868 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:39:20.933 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:39:21.136 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:39:21.479 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:39:21.730 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:39:21.873 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:22.032 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:39:22.191 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:39:22.267 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:22.393 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T03:39:22.493 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:39:22.653 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:39:22.754 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:39:22.863 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:39:23.156 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:39:23.407 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T03:39:23.624 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:39:23.641 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:23.767 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:39:23.835 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:23.969 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T03:39:24.069 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:39:24.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:39:24.328 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T03:39:24.364 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:39:24.490 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:39:24.613 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T03:39:24.808 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:39:24.864 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:39:25.068 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T03:39:25.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T03:39:25.599 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:39:25.619 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:25.734 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T03:39:25.745 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:39:26.018 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:39:26.055 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:39:26.144 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:39:26.307 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T03:39:26.462 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:39:26.558 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T03:39:26.763 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:39:26.810 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:39:27.023 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:39:27.061 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T03:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:39:27.274 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:39:27.337 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:39:27.363 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T03:39:27.463 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T03:39:27.610 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:39:27.735 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:39:27.740 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:39:27.866 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:39:28.129 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:39:28.151 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:39:28.380 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T03:39:28.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:39:28.506 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T03:39:28.678 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:39:28.765 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:28.805 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:39:28.891 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:39:28.932 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:39:29.020 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T03:39:29.192 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:39:29.241 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:39:29.368 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:39:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:39:29.769 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:39:29.786 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T03:39:29.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T03:39:30.029 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T03:39:30.155 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T03:39:30.196 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T03:39:30.407 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:39:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:39:30.550 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:39:30.801 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:39:30.859 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:39:31.160 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T03:39:31.161 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:39:31.437 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T03:39:31.454 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:39:31.563 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T03:39:31.800 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:39:31.831 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T03:39:31.924 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:32.041 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:32.099 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:39:32.151 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:39:32.471 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:39:32.487 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:32.613 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:32.739 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T03:39:32.856 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T03:39:33.024 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:33.149 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:39:33.150 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:33.276 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:33.477 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:39:33.494 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:39:33.494 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:39:33.604 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:33.730 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:33.856 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:39:34.036 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.162 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.209 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.288 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.310 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.414 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:39:34.437 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T03:39:34.713 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.823 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:34.949 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.161 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:39:35.161 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:39:35.588 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.626 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.714 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.752 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.840 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.879 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:35.966 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:36.005 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:39:36.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:36.577 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-09-16T03:39:36.920 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-09-16T03:39:37.088 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-09-16T03:39:37.102 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T03:39:37.233 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T03:39:37.235 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:37.361 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:37.487 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:37.547 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T03:39:37.613 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:37.731 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:38.018 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:38.127 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:38.283 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-09-16T03:39:38.562 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:39:38.562 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:39:38.653 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-09-16T03:39:38.789 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-09-16T03:39:38.805 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T03:39:38.943 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T03:39:39.021 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:39.238 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T03:39:39.366 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T03:39:39.702 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:39.828 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:40.052 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:39:40.052 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:39:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:39:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:39:40.803 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:40.946 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:39:41.085 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:39:41.388 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T03:39:41.571 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:41.852 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:39:41.852 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:39:41.986 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:42.209 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:39:42.210 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:39:42.331 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:42.457 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:42.608 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:42.704 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:42.819 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:39:42.819 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:39:42.925 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:39:42.925 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:39:43.292 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:43.380 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:43.426 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:43.552 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:43.665 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:39:43.665 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:39:43.712 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:44.065 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T03:39:44.165 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:44.174 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T03:39:44.291 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:44.326 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T03:39:44.442 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:44.639 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:39:44.639 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T03:39:45.093 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:45.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:45.450 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:45.630 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T03:39:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T03:39:45.654 DEBUG:teuthology.parallel:result is None 2024-09-16T03:39:45.975 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T03:39:46.103 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T03:39:46.296 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T03:39:47.405 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T03:39:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T03:39:48.051 DEBUG:teuthology.parallel:result is None 2024-09-16T03:39:48.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:39:48.195 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-09-16T03:39:48.214 INFO:teuthology.orchestra.run.smithi073.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:39:48.215 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:39:48.215 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T03:39:48.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:39:48.357 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-09-16T03:39:48.373 INFO:teuthology.orchestra.run.smithi138.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:39:48.373 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:39:48.373 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T03:39:48.375 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T03:39:48.375 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:48.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T03:39:48.390 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:48.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T03:39:48.425 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T03:39:48.425 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:48.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T03:39:48.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T03:39:48.495 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:48.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T03:39:48.509 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T03:39:48.561 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T03:39:48.561 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:48.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T03:39:48.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T03:39:48.628 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:48.628 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T03:39:48.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T03:39:48.693 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T03:39:48.693 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:48.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T03:39:48.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T03:39:48.761 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:48.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T03:39:48.773 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T03:39:48.830 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T03:39:48.907 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T03:39:48.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-16T03:39:48.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-16T03:39:48.922 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T03:39:48.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T03:39:48.966 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T03:39:48.978 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T03:39:48.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T03:39:49.022 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T03:39:49.043 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T03:39:49.043 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-16T03:39:49.043 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892', 'branch': 'squid', 'description': 'rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7905892', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 700, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'], ['osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5616, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '15927/100000', 'suite': 'rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKdLxA0Lp32RbMVphUNP8EMBayAOQXkGi120cc/yWZLAX6QKGp0W7JDGWxQLuDhMFsRV+vxPICam1ZjF6al2/Ss=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCB397NM97aFi0U0c/JpRXYRjOsnf2hckaUktT2vHifvvG4Fp33AQ8hyqX3/zNUDTXHssTXwSpbliskfB5vpcAs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'full_sequential': [{'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33', 'sudo ceph osd pool create test 16 16', 'sudo ceph osd pool set test size 3', 'sudo ceph pg dump pgs --format=json-pretty']}}, {'radosbench': {'clients': ['client.0'], 'create_pool': False, 'objectsize': 1048576, 'pool': 'test', 'time': 360, 'type': 'rand'}}, {'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0']}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:00:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T03:39:49.043 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T03:39:49.078 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T03:39:49.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T03:39:49.126 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T03:39:49.139 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:49.139 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T03:39:49.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T03:39:49.186 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-16T03:39:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T03:39:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 03:34:22.282829466 +0000 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 03:34:22.034831677 +0000 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 03:34:22.034831677 +0000 2024-09-16T03:39:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T03:39:49.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T03:39:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T03:39:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T03:39:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000438703 s, 1.2 MB/s 2024-09-16T03:39:49.289 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T03:39:49.338 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 03:34:22.782825008 +0000 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 03:34:22.542827148 +0000 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 03:34:22.542827148 +0000 2024-09-16T03:39:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T03:39:49.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T03:39:49.439 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T03:39:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T03:39:49.440 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000370053 s, 1.4 MB/s 2024-09-16T03:39:49.441 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T03:39:49.490 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-16T03:39:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 03:34:23.038822726 +0000 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 03:34:23.034822761 +0000 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 03:34:23.034822761 +0000 2024-09-16T03:39:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T03:39:49.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T03:39:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T03:39:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T03:39:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000374212 s, 1.4 MB/s 2024-09-16T03:39:49.593 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T03:39:49.642 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 03:34:23.786816058 +0000 2024-09-16T03:39:49.689 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 03:34:23.554818126 +0000 2024-09-16T03:39:49.690 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 03:34:23.554818126 +0000 2024-09-16T03:39:49.690 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T03:39:49.690 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T03:39:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T03:39:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T03:39:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000401807 s, 1.3 MB/s 2024-09-16T03:39:49.744 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T03:39:49.794 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T03:39:49.794 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:49.794 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T03:39:49.800 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T03:39:49.800 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-16T03:39:49.846 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-16 03:34:22.573365961 +0000 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-16 03:34:22.289368497 +0000 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-16 03:34:22.289368497 +0000 2024-09-16T03:39:49.847 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-16T03:39:49.847 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T03:39:49.901 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-16T03:39:49.901 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-16T03:39:49.901 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000413027 s, 1.2 MB/s 2024-09-16T03:39:49.902 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T03:39:49.952 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-16T03:39:49.998 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T03:39:49.998 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:49.998 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-16T03:39:49.998 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:49.998 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-16 03:34:23.057361637 +0000 2024-09-16T03:39:49.999 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-16 03:34:22.797363960 +0000 2024-09-16T03:39:49.999 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-16 03:34:22.797363960 +0000 2024-09-16T03:39:49.999 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-16T03:39:49.999 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T03:39:50.053 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-16T03:39:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-16T03:39:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000415106 s, 1.2 MB/s 2024-09-16T03:39:50.055 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T03:39:50.105 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-16T03:39:50.150 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-16 03:34:23.489357778 +0000 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-16 03:34:23.273359708 +0000 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-16 03:34:23.273359708 +0000 2024-09-16T03:39:50.151 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-16T03:39:50.151 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T03:39:50.205 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-16T03:39:50.205 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-16T03:39:50.205 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000364565 s, 1.4 MB/s 2024-09-16T03:39:50.206 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T03:39:50.257 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-16 03:34:23.933353812 +0000 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-16 03:34:23.709355813 +0000 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-16 03:34:23.709355813 +0000 2024-09-16T03:39:50.303 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-16T03:39:50.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T03:39:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-16T03:39:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-16T03:39:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000346224 s, 1.5 MB/s 2024-09-16T03:39:50.359 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T03:39:50.407 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T03:39:50.407 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-16T03:39:50.408 INFO:tasks.ceph:Generating config... 2024-09-16T03:39:50.409 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-09-16T03:39:50.409 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-16T03:39:50.409 INFO:tasks.ceph:[global] ms type = async 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T03:39:50.409 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-16T03:39:50.409 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-16T03:39:50.410 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-16T03:39:50.411 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-16T03:39:50.411 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T03:39:50.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T03:39:50.445 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T03:39:50.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T03:39:50.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T03:39:50.588 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.73:6789]')] 2024-09-16T03:39:50.588 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.73:6789]', 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2024-09-16T03:39:50.589 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:50.589 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T03:39:50.637 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.73:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:50.717 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:50.717 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 5ce79052-9b5c-4295-9224-2993bbcd9fb9 2024-09-16T03:39:50.717 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-16T03:39:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-16T03:39:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 5ce79052-9b5c-4295-9224-2993bbcd9fb9 2024-09-16T03:39:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-16T03:39:50.716868+0000 2024-09-16T03:39:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-16T03:39:50.716868+0000 2024-09-16T03:39:50.718 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-09-16T03:39:50.719 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-09-16T03:39:50.719 INFO:teuthology.orchestra.run.smithi073.stdout:0: v1:172.21.15.73:6789/0 mon.a 2024-09-16T03:39:50.719 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T03:39:50.721 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T03:39:50.769 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5ce79052-9b5c-4295-9224-2993bbcd9fb9... 2024-09-16T03:39:50.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T03:39:50.814 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T03:39:50.841 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-16T03:39:50.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-16T03:39:50.843 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.844 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = [v1:172.21.15.73:6789] 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: mon election default strategy = 1 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: ms bind msgr2 = False 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: ms type = async 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 5ce79052-9b5c-4295-9224-2993bbcd9fb9 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.845 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-16T03:39:50.846 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-16T03:39:50.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = lz4 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore zero block detection = True 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T03:39:50.848 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify cached snaps = True 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify missing on start = True 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock override recovery settings = True 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue = debug_random 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue cut off = debug_random 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-16T03:39:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-16T03:39:50.850 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T03:39:50.851 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub interval = 300 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-16T03:39:50.852 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-16T03:39:50.853 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-16T03:39:50.854 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T03:39:50.855 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = [v1:172.21.15.73:6789] 2024-09-16T03:39:50.856 INFO:teuthology.orchestra.run.smithi138.stdout: mon election default strategy = 1 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: ms bind msgr2 = False 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: ms type = async 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 5ce79052-9b5c-4295-9224-2993bbcd9fb9 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-16T03:39:50.857 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression algorithm = lz4 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression mode = aggressive 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore zero block detection = True 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-09-16T03:39:50.859 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify cached snaps = True 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify missing on start = True 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-16T03:39:50.860 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock override recovery settings = True 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue = debug_random 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue cut off = debug_random 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-16T03:39:50.861 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-16T03:39:50.865 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-16T03:39:50.866 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: mon scrub interval = 300 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T03:39:50.867 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-16T03:39:50.868 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T03:39:50.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T03:39:50.961 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T03:39:50.961 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:50.961 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T03:39:50.967 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:50.967 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T03:39:51.012 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:39:51.013 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:51.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T03:39:51.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T03:39:51.077 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:39:51.077 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:51.125 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:39:51.125 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:51.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T03:39:51.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T03:39:51.149 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:39:51.149 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:51.195 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T03:39:51.195 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T03:39:51.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T03:39:51.238 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T03:39:51.241 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T03:39:51.241 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T03:39:51.241 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T03:39:51.276 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T03:39:51.291 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T03:39:51.291 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-16T03:39:51.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T03:39:51.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T03:39:51.305 INFO:tasks.ceph:role: osd.0 2024-09-16T03:39:51.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:39:51.305 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T03:39:51.372 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:39:51.372 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:39:51.372 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:39:51.373 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:39:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-16T03:39:51.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T03:39:51.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T03:39:51.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T03:39:51.938 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:39:51.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:39:51.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T03:39:51.992 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T03:39:51.992 INFO:tasks.ceph:role: osd.1 2024-09-16T03:39:51.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:39:51.992 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:39:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:39:52.058 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:39:52.058 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:39:52.535 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-16T03:39:52.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T03:39:52.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T03:39:52.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T03:39:52.683 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:39:52.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:39:52.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T03:39:52.744 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T03:39:52.744 INFO:tasks.ceph:role: osd.2 2024-09-16T03:39:52.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:39:52.745 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T03:39:52.808 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:39:52.808 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:39:52.808 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:39:52.808 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:39:52.809 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:39:53.290 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-16T03:39:53.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T03:39:53.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T03:39:53.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T03:39:53.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:39:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:39:53.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:53.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:53.566+0000 7fb9197487c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T03:39:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:53.566+0000 7fb9197487c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T03:39:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:53.566+0000 7fb9197487c0 -1 bdev(0x5584fcdd3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T03:39:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:53.566+0000 7fb9197487c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T03:39:56.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T03:39:56.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:39:56.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:56.798+0000 7f30a9d337c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T03:39:56.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:56.802+0000 7f30a9d337c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T03:39:56.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:56.802+0000 7f30a9d337c0 -1 bdev(0x557a69085800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T03:39:56.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:39:56.802+0000 7f30a9d337c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T03:39:59.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T03:40:00.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:40:00.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:40:00.082+0000 7fea349137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T03:40:00.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:40:00.082+0000 7fea349137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T03:40:00.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:40:00.082+0000 7fea349137c0 -1 bdev(0x56246e1d1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T03:40:00.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T03:40:00.082+0000 7fea349137c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T03:40:03.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T03:40:03.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T03:40:03.296 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T03:40:03.296 INFO:tasks.ceph:role: osd.3 2024-09-16T03:40:03.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:40:03.296 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T03:40:03.358 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:40:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:40:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:40:03.359 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:40:03.837 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-16T03:40:03.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-16T03:40:03.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-16T03:40:03.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T03:40:03.992 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:40:03.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:40:03.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T03:40:04.050 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T03:40:04.050 INFO:tasks.ceph:role: osd.4 2024-09-16T03:40:04.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:40:04.050 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:40:04.114 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:40:04.115 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:40:04.115 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:40:04.115 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:40:04.115 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:40:04.556 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-16T03:40:04.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-16T03:40:04.559 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-16T03:40:04.648 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T03:40:04.659 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:40:04.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:40:04.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T03:40:04.714 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T03:40:04.714 INFO:tasks.ceph:role: osd.5 2024-09-16T03:40:04.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:40:04.714 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T03:40:04.778 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-16T03:40:04.779 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T03:40:04.779 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T03:40:04.779 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T03:40:04.779 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T03:40:05.237 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-16T03:40:05.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-16T03:40:05.240 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-16T03:40:05.356 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T03:40:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T03:40:05.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:40:05.367 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:40:05.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:05.479+0000 7fc515af37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T03:40:05.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:05.483+0000 7fc515af37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T03:40:05.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:05.483+0000 7fc515af37c0 -1 bdev(0x561e27679800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T03:40:05.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:05.483+0000 7fc515af37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T03:40:08.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T03:40:08.621 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:40:08.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:08.699+0000 7f3d6fad87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T03:40:08.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:08.699+0000 7f3d6fad87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T03:40:08.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:08.699+0000 7f3d6fad87c0 -1 bdev(0x563c7588b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T03:40:08.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:08.699+0000 7f3d6fad87c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T03:40:11.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T03:40:11.931 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:40:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:12.011+0000 7f5d7b05f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T03:40:12.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:12.011+0000 7f5d7b05f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T03:40:12.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:12.011+0000 7f5d7b05f7c0 -1 bdev(0x55855bb1d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T03:40:12.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-16T03:40:12.011+0000 7f5d7b05f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T03:40:15.161 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T03:40:15.216 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T03:40:15.216 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:15.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T03:40:15.230 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:15.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T03:40:15.283 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:15.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T03:40:15.337 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:15.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T03:40:15.395 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:15.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T03:40:15.409 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:15.409 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T03:40:15.465 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:15.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T03:40:15.517 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:15.517 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T03:40:15.562 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T03:40:15.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T03:40:15.574 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-16T03:40:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCHqOdmSMEwDhAAKmzaw9WhPyTBZfPwVqCn0g== 2024-09-16T03:40:15.574 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-16T03:40:15.574 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCJqOdms1f/IRAAXBBH47D8U/7BR35/+K3Omw== 2024-09-16T03:40:15.574 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCMqOdmvxrnLxAA3xkrWoGGql0z2DyZR/84qQ== 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCQqOdmDRMzBRAAu8EL5H6coKsU8x50qrXQ+A== 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCVqOdmce72HBAA3qrCbFehPCsEyIHlIEBmvA== 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCYqOdmIOgEKhAAfjLTouRxDoR50wmndlsXOQ== 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCcqOdmvykIARAAz9Fg/M8B2w1PpQ9m5ZVibA== 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-16T03:40:15.575 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCHqOdmyHCIEBAA2uRXea38SNQvCwHiYksViA== 2024-09-16T03:40:15.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T03:40:15.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:15.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:15.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:15.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:15.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:16.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T03:40:16.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T03:40:16.212 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T03:40:16.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T03:40:16.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T03:40:16.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T03:40:16.320 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T03:40:16.368 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T03:40:16.368 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T03:40:16.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T03:40:16.413 INFO:tasks.ceph.mon.a:Started 2024-09-16T03:40:16.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph config set mgr mgr_pool false --force 2024-09-16T03:40:16.662 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T03:40:16.662 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T03:40:16.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T03:40:16.665 INFO:tasks.ceph.mgr.x:Started 2024-09-16T03:40:16.665 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T03:40:16.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T03:40:16.836 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-16T03:40:16.853 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T03:40:16.853 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T03:40:16.854 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:16.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T03:40:16.865 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:16.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T03:40:16.920 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T03:40:16.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T03:40:16.975 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:16.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T03:40:16.989 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:16.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T03:40:17.045 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-16T03:40:17.045 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T03:40:17.101 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new cc723b38-7dda-4324-b461-72f7a23622b2 0 2024-09-16T03:40:17.337 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:17.334+0000 7fe41eaa8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T03:40:17.355 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-09-16T03:40:17.372 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new b17eb455-f200-4546-b9ac-f41f7f9be2a4 1 2024-09-16T03:40:17.568 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-09-16T03:40:17.585 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 1a7e2927-e459-494a-a8c0-9ab5907f527d 2 2024-09-16T03:40:17.787 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-09-16T03:40:17.805 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 42ff12dc-8175-4cc9-a53e-c6181f51893d 3 2024-09-16T03:40:17.879 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:17.874+0000 7fe41eaa8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T03:40:18.000 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-09-16T03:40:18.016 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new aacddc43-13b4-40df-8318-235cda520717 4 2024-09-16T03:40:18.102 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.098+0000 7fe41eaa8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T03:40:18.211 INFO:teuthology.orchestra.run.smithi138.stdout:4 2024-09-16T03:40:18.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new f4239c62-4940-435b-9aaf-0f42da29d537 5 2024-09-16T03:40:18.411 INFO:teuthology.orchestra.run.smithi138.stdout:5 2024-09-16T03:40:18.428 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T03:40:18.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T03:40:18.431 INFO:tasks.ceph.osd.0:Started 2024-09-16T03:40:18.431 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T03:40:18.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T03:40:18.434 INFO:tasks.ceph.osd.1:Started 2024-09-16T03:40:18.434 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T03:40:18.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T03:40:18.436 INFO:tasks.ceph.osd.2:Started 2024-09-16T03:40:18.437 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T03:40:18.437 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T03:40:18.439 INFO:tasks.ceph.osd.3:Started 2024-09-16T03:40:18.439 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T03:40:18.439 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T03:40:18.441 INFO:tasks.ceph.osd.4:Started 2024-09-16T03:40:18.441 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T03:40:18.441 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T03:40:18.443 INFO:tasks.ceph.osd.5:Started 2024-09-16T03:40:18.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:18.641 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:18.642 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:18.409863+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:18.658 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T03:40:18.658 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T03:40:18.727 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.722+0000 7fe41eaa8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T03:40:18.781 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.778+0000 7fe41eaa8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T03:40:18.834 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.830+0000 7fe41eaa8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T03:40:18.911 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.906+0000 7fe41eaa8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T03:40:18.964 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:18.958+0000 7fe41eaa8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T03:40:19.041 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:19.038+0000 7fe41eaa8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T03:40:19.094 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:19.090+0000 7fe41eaa8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T03:40:19.244 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:19.238+0000 7fe41eaa8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T03:40:19.263 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:19.306 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:19.302+0000 7fe41eaa8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T03:40:19.435 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-16T03:40:19.435 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":8,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:18.409863+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:19.449 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-16T03:40:19.543 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-09-16T03:40:19.539+0000 7f0aa5c287c0 -1 Falling back to public interface 2024-09-16T03:40:19.574 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T03:40:19.570+0000 7fa4c90eb7c0 -1 Falling back to public interface 2024-09-16T03:40:19.795 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-09-16T03:40:19.791+0000 7f72c7c7c7c0 -1 Falling back to public interface 2024-09-16T03:40:19.803 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-16T03:40:19.799+0000 7f270a1587c0 -1 Falling back to public interface 2024-09-16T03:40:19.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:40:19.838+0000 7fdb5c4e17c0 -1 Falling back to public interface 2024-09-16T03:40:20.025 INFO:tasks.ceph.mgr.x.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T03:40:20.025 INFO:tasks.ceph.mgr.x.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T03:40:20.025 INFO:tasks.ceph.mgr.x.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-09-16T03:40:20.066 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T03:40:20.062+0000 7f46ab0847c0 -1 Falling back to public interface 2024-09-16T03:40:20.096 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:20.094+0000 7fe41eaa8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T03:40:20.245 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:20.242+0000 7fe41eaa8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T03:40:20.400 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:20.398+0000 7fe41eaa8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T03:40:20.464 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:20.458+0000 7fe41eaa8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T03:40:20.598 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:20.594+0000 7fe41eaa8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T03:40:21.204 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.198+0000 7fe41eaa8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T03:40:21.279 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.274+0000 7fe41eaa8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T03:40:21.460 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.458+0000 7fe41eaa8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T03:40:21.533 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.530+0000 7fe41eaa8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T03:40:21.823 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.818+0000 7fe41eaa8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T03:40:21.885 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:21.882+0000 7fe41eaa8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T03:40:22.919 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-16T03:40:22.914+0000 7fe3c55e0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T03:40:23.459 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-09-16T03:40:23.455+0000 7f0aa5c287c0 -1 osd.4 0 log_to_monitors true 2024-09-16T03:40:23.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T03:40:23.650+0000 7fa4c90eb7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:40:23.754 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-16T03:40:23.751+0000 7f270a1587c0 -1 osd.3 0 log_to_monitors true 2024-09-16T03:40:23.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:40:23.870+0000 7fdb5c4e17c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:40:23.967 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-09-16T03:40:23.963+0000 7f72c7c7c7c0 -1 osd.5 0 log_to_monitors true 2024-09-16T03:40:24.136 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T03:40:24.134+0000 7f46ab0847c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:40:24.936 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-09-16T03:40:24.931+0000 7f0aa1bd1640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T03:40:24.943 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-09-16T03:40:24.939+0000 7f0a9da0e640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:25.537 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-16T03:40:25.531+0000 7f2706101640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T03:40:25.543 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-16T03:40:25.539+0000 7f26fdf36640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:25.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:40:25.694+0000 7fdb5848a640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T03:40:25.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:40:25.698+0000 7fdb502bf640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:25.737 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T03:40:25.734+0000 7fa4c5094640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T03:40:25.742 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T03:40:25.738+0000 7fa4bcec9640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:26.054 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:26.351 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-16T03:40:26.351 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":11,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:25.919591+0000","last_up_change":"2024-09-16T03:40:25.919591+0000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":3688580009}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":3688580009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":3688580009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":3688580009}]},"public_addr":"172.21.15.73:6800/3688580009","cluster_addr":"172.21.15.73:6801/3688580009","heartbeat_back_addr":"172.21.15.73:6803/3688580009","heartbeat_front_addr":"172.21.15.73:6802/3688580009","state":["exists","up"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":1689880506}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":1689880506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":1689880506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":1689880506}]},"public_addr":"172.21.15.73:6804/1689880506","cluster_addr":"172.21.15.73:6805/1689880506","heartbeat_back_addr":"172.21.15.73:6807/1689880506","heartbeat_front_addr":"172.21.15.73:6806/1689880506","state":["exists","up"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":1591405063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":1591405063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":1591405063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":1591405063}]},"public_addr":"172.21.15.138:6808/1591405063","cluster_addr":"172.21.15.138:6809/1591405063","heartbeat_back_addr":"172.21.15.138:6811/1591405063","heartbeat_front_addr":"172.21.15.138:6810/1591405063","state":["exists","up"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":2286792550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":2286792550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":2286792550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":2286792550}]},"public_addr":"172.21.15.138:6800/2286792550","cluster_addr":"172.21.15.138:6801/2286792550","heartbeat_back_addr":"172.21.15.138:6803/2286792550","heartbeat_front_addr":"172.21.15.138:6802/2286792550","state":["exists","up"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:26.370 DEBUG:teuthology.misc:4 of 6 OSDs are up 2024-09-16T03:40:26.537 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-09-16T03:40:26.531+0000 7f72c3c25640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T03:40:26.544 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-09-16T03:40:26.539+0000 7f72bba5a640 -1 osd.5 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:26.586 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T03:40:26.582+0000 7f46a783f640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T03:40:26.590 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T03:40:26.586+0000 7f469ee62640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T03:40:32.977 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:33.267 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-16T03:40:33.267 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":13,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:27.939713+0000","last_up_change":"2024-09-16T03:40:26.929108+0000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":3688580009}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":3688580009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":3688580009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":3688580009}]},"public_addr":"172.21.15.73:6800/3688580009","cluster_addr":"172.21.15.73:6801/3688580009","heartbeat_back_addr":"172.21.15.73:6803/3688580009","heartbeat_front_addr":"172.21.15.73:6802/3688580009","state":["exists","up"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":1689880506}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":1689880506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":1689880506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":1689880506}]},"public_addr":"172.21.15.73:6804/1689880506","cluster_addr":"172.21.15.73:6805/1689880506","heartbeat_back_addr":"172.21.15.73:6807/1689880506","heartbeat_front_addr":"172.21.15.73:6806/1689880506","state":["exists","up"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":754981219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":754981219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":754981219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":754981219}]},"public_addr":"172.21.15.73:6808/754981219","cluster_addr":"172.21.15.73:6809/754981219","heartbeat_back_addr":"172.21.15.73:6811/754981219","heartbeat_front_addr":"172.21.15.73:6810/754981219","state":["exists","up"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":1591405063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":1591405063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":1591405063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":1591405063}]},"public_addr":"172.21.15.138:6808/1591405063","cluster_addr":"172.21.15.138:6809/1591405063","heartbeat_back_addr":"172.21.15.138:6811/1591405063","heartbeat_front_addr":"172.21.15.138:6810/1591405063","state":["exists","up"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":2286792550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":2286792550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":2286792550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":2286792550}]},"public_addr":"172.21.15.138:6800/2286792550","cluster_addr":"172.21.15.138:6801/2286792550","heartbeat_back_addr":"172.21.15.138:6803/2286792550","heartbeat_front_addr":"172.21.15.138:6802/2286792550","state":["exists","up"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":2313720468}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":2313720468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":2313720468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":2313720468}]},"public_addr":"172.21.15.138:6804/2313720468","cluster_addr":"172.21.15.138:6805/2313720468","heartbeat_back_addr":"172.21.15.138:6807/2313720468","heartbeat_front_addr":"172.21.15.138:6806/2313720468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.641381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.871959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:25.131075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.712196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.442534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.997771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:33.282 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-16T03:40:33.283 INFO:tasks.ceph:Creating RBD pool 2024-09-16T03:40:33.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T03:40:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-09-16T03:40:33.982 DEBUG:teuthology.orchestra.run.smithi073:> rbd --cluster ceph pool init rbd 2024-09-16T03:40:37.005 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T03:40:37.006 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T03:40:37.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T03:40:37.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T03:40:37.007 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T03:40:37.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:37.363 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":176751066}]},"active_addr":"172.21.15.73:6812/176751066","active_change":"2024-09-16T03:40:21.905678+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1135061055}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1944737763}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2994904492}]}]} 2024-09-16T03:40:37.365 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T03:40:37.365 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T03:40:37.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:37.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:37.659 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:36.972814+0000","last_up_change":"2024-09-16T03:40:26.929108+0000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T03:40:33.592384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":3688580009}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":3688580009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":3688580009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":3688580009}]},"public_addr":"172.21.15.73:6800/3688580009","cluster_addr":"172.21.15.73:6801/3688580009","heartbeat_back_addr":"172.21.15.73:6803/3688580009","heartbeat_front_addr":"172.21.15.73:6802/3688580009","state":["exists","up"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":1689880506}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":1689880506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":1689880506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":1689880506}]},"public_addr":"172.21.15.73:6804/1689880506","cluster_addr":"172.21.15.73:6805/1689880506","heartbeat_back_addr":"172.21.15.73:6807/1689880506","heartbeat_front_addr":"172.21.15.73:6806/1689880506","state":["exists","up"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":754981219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":754981219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":754981219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":754981219}]},"public_addr":"172.21.15.73:6808/754981219","cluster_addr":"172.21.15.73:6809/754981219","heartbeat_back_addr":"172.21.15.73:6811/754981219","heartbeat_front_addr":"172.21.15.73:6810/754981219","state":["exists","up"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":1591405063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":1591405063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":1591405063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":1591405063}]},"public_addr":"172.21.15.138:6808/1591405063","cluster_addr":"172.21.15.138:6809/1591405063","heartbeat_back_addr":"172.21.15.138:6811/1591405063","heartbeat_front_addr":"172.21.15.138:6810/1591405063","state":["exists","up"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":2286792550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":2286792550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":2286792550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":2286792550}]},"public_addr":"172.21.15.138:6800/2286792550","cluster_addr":"172.21.15.138:6801/2286792550","heartbeat_back_addr":"172.21.15.138:6803/2286792550","heartbeat_front_addr":"172.21.15.138:6802/2286792550","state":["exists","up"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":2313720468}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":2313720468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":2313720468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":2313720468}]},"public_addr":"172.21.15.138:6804/2313720468","cluster_addr":"172.21.15.138:6805/2313720468","heartbeat_back_addr":"172.21.15.138:6807/2313720468","heartbeat_front_addr":"172.21.15.138:6806/2313720468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.641381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.871959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:25.131075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.712196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.442534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.997771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:37.677 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T03:40:37.677 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T03:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:36.972814+0000","last_up_change":"2024-09-16T03:40:26.929108+0000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T03:40:33.592384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":3688580009}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":3688580009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":3688580009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":3688580009}]},"public_addr":"172.21.15.73:6800/3688580009","cluster_addr":"172.21.15.73:6801/3688580009","heartbeat_back_addr":"172.21.15.73:6803/3688580009","heartbeat_front_addr":"172.21.15.73:6802/3688580009","state":["exists","up"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":1689880506}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":1689880506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":1689880506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":1689880506}]},"public_addr":"172.21.15.73:6804/1689880506","cluster_addr":"172.21.15.73:6805/1689880506","heartbeat_back_addr":"172.21.15.73:6807/1689880506","heartbeat_front_addr":"172.21.15.73:6806/1689880506","state":["exists","up"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":754981219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":754981219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":754981219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":754981219}]},"public_addr":"172.21.15.73:6808/754981219","cluster_addr":"172.21.15.73:6809/754981219","heartbeat_back_addr":"172.21.15.73:6811/754981219","heartbeat_front_addr":"172.21.15.73:6810/754981219","state":["exists","up"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":1591405063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":1591405063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":1591405063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":1591405063}]},"public_addr":"172.21.15.138:6808/1591405063","cluster_addr":"172.21.15.138:6809/1591405063","heartbeat_back_addr":"172.21.15.138:6811/1591405063","heartbeat_front_addr":"172.21.15.138:6810/1591405063","state":["exists","up"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":2286792550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":2286792550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":2286792550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":2286792550}]},"public_addr":"172.21.15.138:6800/2286792550","cluster_addr":"172.21.15.138:6801/2286792550","heartbeat_back_addr":"172.21.15.138:6803/2286792550","heartbeat_front_addr":"172.21.15.138:6802/2286792550","state":["exists","up"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":2313720468}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":2313720468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":2313720468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":2313720468}]},"public_addr":"172.21.15.138:6804/2313720468","cluster_addr":"172.21.15.138:6805/2313720468","heartbeat_back_addr":"172.21.15.138:6807/2313720468","heartbeat_front_addr":"172.21.15.138:6806/2313720468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.641381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.871959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:25.131075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.712196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.442534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.997771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:40:37.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T03:40:37.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T03:40:37.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T03:40:37.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T03:40:37.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T03:40:37.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T03:40:38.149 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-16T03:40:38.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T03:40:38.160 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:38.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T03:40:38.201 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:38.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T03:40:38.210 INFO:teuthology.orchestra.run.smithi073.stdout:51539607556 2024-09-16T03:40:38.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T03:40:38.217 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:38.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T03:40:38.226 INFO:teuthology.orchestra.run.smithi073.stdout:51539607557 2024-09-16T03:40:38.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T03:40:38.505 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2024-09-16T03:40:38.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2024-09-16T03:40:38.548 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-16T03:40:38.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-09-16T03:40:38.623 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-16T03:40:38.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.0 2024-09-16T03:40:38.661 INFO:teuthology.orchestra.run.smithi073.stdout:51539607554 2024-09-16T03:40:38.673 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-16T03:40:38.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607554 for osd.2 2024-09-16T03:40:38.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.4 2024-09-16T03:40:38.707 INFO:teuthology.orchestra.run.smithi073.stdout:51539607555 2024-09-16T03:40:38.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607555 for osd.5 2024-09-16T03:40:39.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T03:40:39.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T03:40:39.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T03:40:39.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T03:40:39.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T03:40:39.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T03:40:39.906 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2024-09-16T03:40:39.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2024-09-16T03:40:39.984 INFO:teuthology.orchestra.run.smithi073.stdout:51539607554 2024-09-16T03:40:39.988 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:40.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2024-09-16T03:40:40.007 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:40.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607554 for osd.2 2024-09-16T03:40:40.021 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:40.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2024-09-16T03:40:40.038 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:40.076 INFO:teuthology.orchestra.run.smithi073.stdout:51539607557 2024-09-16T03:40:40.089 INFO:teuthology.orchestra.run.smithi073.stdout:47244640261 2024-09-16T03:40:40.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.5 2024-09-16T03:40:40.093 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:40.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.4 2024-09-16T03:40:40.105 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:40.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T03:40:41.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T03:40:41.225 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-16T03:40:41.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.1 2024-09-16T03:40:41.241 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:41.307 INFO:teuthology.orchestra.run.smithi073.stdout:51539607556 2024-09-16T03:40:41.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607556 for osd.2 2024-09-16T03:40:41.324 DEBUG:teuthology.parallel:result is None 2024-09-16T03:40:41.324 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T03:40:41.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:40:41.608 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:41.609 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:40:41.626 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T03:40:41.500372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163056,"kb_used_data":864,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067984,"statfs":{"total":579820584960,"available":579653615616,"internally_reserved":0,"allocated":884736,"data_stored":253528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.525059"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.945444+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:40:37.945444+0000","last_peered":"2024-09-16T03:40:37.945444+0000","last_clean":"2024-09-16T03:40:37.945444+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:40:37.945444+0000","last_undegraded":"2024-09-16T03:40:37.945444+0000","last_fullsized":"2024-09-16T03:40:37.945444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.060954+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:40:37.060954+0000","last_peered":"2024-09-16T03:40:37.060954+0000","last_clean":"2024-09-16T03:40:37.060954+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:40:37.060954+0000","last_undegraded":"2024-09-16T03:40:37.060954+0000","last_fullsized":"2024-09-16T03:40:37.060954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:36.985560+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:40:36.985560+0000","last_peered":"2024-09-16T03:40:36.985560+0000","last_clean":"2024-09-16T03:40:36.985560+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:40:36.985560+0000","last_undegraded":"2024-09-16T03:40:36.985560+0000","last_fullsized":"2024-09-16T03:40:36.985560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.944455+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:40:37.944455+0000","last_peered":"2024-09-16T03:40:37.944455+0000","last_clean":"2024-09-16T03:40:37.944455+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:40:37.944455+0000","last_undegraded":"2024-09-16T03:40:37.944455+0000","last_fullsized":"2024-09-16T03:40:37.944455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.944614+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:40:37.944614+0000","last_peered":"2024-09-16T03:40:37.944614+0000","last_clean":"2024-09-16T03:40:37.944614+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:40:37.944614+0000","last_undegraded":"2024-09-16T03:40:37.944614+0000","last_fullsized":"2024-09-16T03:40:37.944614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:36.985871+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:40:36.985871+0000","last_peered":"2024-09-16T03:40:36.985871+0000","last_clean":"2024-09-16T03:40:36.985871+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:40:36.985871+0000","last_undegraded":"2024-09-16T03:40:36.985871+0000","last_fullsized":"2024-09-16T03:40:36.985871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.945242+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:40:37.945242+0000","last_peered":"2024-09-16T03:40:37.945242+0000","last_clean":"2024-09-16T03:40:37.945242+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:40:37.945242+0000","last_undegraded":"2024-09-16T03:40:37.945242+0000","last_fullsized":"2024-09-16T03:40:37.945242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.061061+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:40:37.061061+0000","last_peered":"2024-09-16T03:40:37.061061+0000","last_clean":"2024-09-16T03:40:37.061061+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:40:37.061061+0000","last_undegraded":"2024-09-16T03:40:37.061061+0000","last_fullsized":"2024-09-16T03:40:37.061061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":139264,"data_stored":39130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":42891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":42891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:40:41.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:40:41.901 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:41.902 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:40:41.917 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T03:40:41.500372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163056,"kb_used_data":864,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067984,"statfs":{"total":579820584960,"available":579653615616,"internally_reserved":0,"allocated":884736,"data_stored":253528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.525059"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.945444+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:40:37.945444+0000","last_peered":"2024-09-16T03:40:37.945444+0000","last_clean":"2024-09-16T03:40:37.945444+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:40:37.945444+0000","last_undegraded":"2024-09-16T03:40:37.945444+0000","last_fullsized":"2024-09-16T03:40:37.945444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.060954+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:40:37.060954+0000","last_peered":"2024-09-16T03:40:37.060954+0000","last_clean":"2024-09-16T03:40:37.060954+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:40:37.060954+0000","last_undegraded":"2024-09-16T03:40:37.060954+0000","last_fullsized":"2024-09-16T03:40:37.060954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:36.985560+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:40:36.985560+0000","last_peered":"2024-09-16T03:40:36.985560+0000","last_clean":"2024-09-16T03:40:36.985560+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:40:36.985560+0000","last_undegraded":"2024-09-16T03:40:36.985560+0000","last_fullsized":"2024-09-16T03:40:36.985560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.944455+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:40:37.944455+0000","last_peered":"2024-09-16T03:40:37.944455+0000","last_clean":"2024-09-16T03:40:37.944455+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:40:37.944455+0000","last_undegraded":"2024-09-16T03:40:37.944455+0000","last_fullsized":"2024-09-16T03:40:37.944455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.944614+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:40:37.944614+0000","last_peered":"2024-09-16T03:40:37.944614+0000","last_clean":"2024-09-16T03:40:37.944614+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:40:37.944614+0000","last_undegraded":"2024-09-16T03:40:37.944614+0000","last_fullsized":"2024-09-16T03:40:37.944614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:36.985871+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:40:36.985871+0000","last_peered":"2024-09-16T03:40:36.985871+0000","last_clean":"2024-09-16T03:40:36.985871+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:40:36.985871+0000","last_undegraded":"2024-09-16T03:40:36.985871+0000","last_fullsized":"2024-09-16T03:40:36.985871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.945242+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:40:37.945242+0000","last_peered":"2024-09-16T03:40:37.945242+0000","last_clean":"2024-09-16T03:40:37.945242+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:40:37.945242+0000","last_undegraded":"2024-09-16T03:40:37.945242+0000","last_fullsized":"2024-09-16T03:40:37.945242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T03:40:37.061061+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:40:37.061061+0000","last_peered":"2024-09-16T03:40:37.061061+0000","last_clean":"2024-09-16T03:40:37.061061+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:40:37.061061+0000","last_undegraded":"2024-09-16T03:40:37.061061+0000","last_fullsized":"2024-09-16T03:40:37.061061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":139264,"data_stored":39130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":42891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":42872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":42891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:40:41.918 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T03:40:41.918 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T03:40:41.918 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T03:40:41.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T03:40:42.233 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:40:42.233 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T03:40:42.249 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T03:40:42.250 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T03:40:42.260 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-16T03:40:42.261 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T03:40:42.261 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:40:42.262 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33' 2024-09-16T03:40:42.424 INFO:teuthology.orchestra.run.smithi138.stdout:{} 2024-09-16T03:40:42.424 INFO:teuthology.orchestra.run.smithi138.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T03:40:42.441 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33' 2024-09-16T03:40:42.585 INFO:teuthology.orchestra.run.smithi138.stdout:{} 2024-09-16T03:40:42.585 INFO:teuthology.orchestra.run.smithi138.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T03:40:42.601 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create test 16 16' 2024-09-16T03:40:43.502 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'test' created 2024-09-16T03:40:43.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set test size 3' 2024-09-16T03:40:44.508 INFO:teuthology.orchestra.run.smithi138.stderr:set pool 2 size to 3 2024-09-16T03:40:44.534 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph pg dump pgs --format=json-pretty' 2024-09-16T03:40:44.848 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-16T03:40:44.848 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "pg_ready": true, 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "pg_stats": [ 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.f", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.849 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.850 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.851 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.852 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.853 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.854 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.855 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.e", 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.856 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.860 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.861 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.862 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.863 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.865 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.d", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.867 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.868 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.869 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.870 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.871 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.872 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.873 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.c", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.874 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.875 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.876 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.877 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.878 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.879 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.b", 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.881 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.882 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.883 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.884 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.887 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.888 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.a", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.889 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.890 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.891 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.892 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.893 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.895 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.9", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.896 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.897 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.898 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.899 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.902 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.8", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.903 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.904 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.907 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.908 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.909 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.0", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 21, 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 18, 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.061587+0000", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.910 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.673003+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.673003+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:41.761473+0000", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.911 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.912 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000", 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00090953200000000001, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.914 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.915 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: 3, 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:44.916 INFO:teuthology.orchestra.run.smithi138.stdout: 3, 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 3, 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 3, 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.3", 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.917 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.918 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.919 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.920 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.921 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.922 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.923 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.924 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.1", 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 19, 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.925 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.945776+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.672624+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.672624+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:37.945242+0000", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.926 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.927 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000", 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.000807407, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.928 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.929 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.930 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: 5, 2024-09-16T03:40:44.931 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: 5, 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 5, 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 5, 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.932 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.2", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.933 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.934 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.935 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.936 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.937 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.938 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.2", 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "17'2", 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 21, 2024-09-16T03:40:44.940 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.672762+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.672762+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:36.985871+0000", 2024-09-16T03:40:44.941 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.942 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 2, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 2, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000", 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.943 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00079228299999999996, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 19, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 1, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 2, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 1, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 2, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 2, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.945 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: 4, 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: 4, 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.947 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 4, 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 4, 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.1", 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.949 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.950 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.951 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.952 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.953 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.3", 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "15'1", 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 20, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:44.955 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.945198+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:34.972645+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:34.972645+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:37.944614+0000", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.956 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 1, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 1, 2024-09-16T03:40:44.957 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000", 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.0010221679999999999, 2024-09-16T03:40:44.958 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 1, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 2, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 1, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.959 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.960 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.961 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: 1, 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: 5 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: 1, 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: 5 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 1, 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 1, 2024-09-16T03:40:44.962 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.0", 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.963 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.964 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.965 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.967 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.968 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.969 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.7", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.971 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.972 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.973 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.974 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.975 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.976 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.977 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.977 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.977 INFO:teuthology.orchestra.run.smithi138.stderr:dumped pgs 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.978 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.4", 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 19, 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.979 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.944709+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:34.972743+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:34.972743+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:37.944455+0000", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.980 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.981 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000", 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00061686399999999995, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.982 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.983 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.984 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: 1, 2024-09-16T03:40:44.985 INFO:teuthology.orchestra.run.smithi138.stdout: 3 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: 1, 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: 3 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 1, 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 1, 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:44.986 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.6", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.987 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.988 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.989 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.990 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.991 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:44.992 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:44.993 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.5", 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 19, 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:36.986005+0000", 2024-09-16T03:40:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.129243+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.129243+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:36.985560+0000", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:44.995 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:44.996 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000", 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00088009999999999998, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:44.997 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:44.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:44.999 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.000 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: 4, 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: 2 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: 4, 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: 2 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 4, 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 4, 2024-09-16T03:40:45.001 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.5", 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:45.002 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:45.003 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:45.004 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:45.005 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:45.006 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:45.007 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:45.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.6", 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 21, 2024-09-16T03:40:45.009 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 18, 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.061350+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.672931+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.672931+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:41.761458+0000", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:45.010 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:45.011 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000", 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:45.012 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00071204999999999999, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:45.013 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:45.014 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:45.015 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: 3, 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: 3, 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: 0 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:45.016 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 3, 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 3, 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "1.7", 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 19, 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 17, 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "active+clean", 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.017 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:37.945917+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "2024-09-16T03:40:35.129262+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "2024-09-16T03:40:35.129262+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:37.945444+0000", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 14, 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:45.018 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 14, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 15, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:33.949325+0000", 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:45.019 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000", 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0.00085206099999999999, 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:45.020 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:45.021 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:45.022 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:45.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [ 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: 5, 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [ 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: 5, 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": 5, 2024-09-16T03:40:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": 5, 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [ 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "start": "2", 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "length": "1" 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "pgid": "2.4", 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "version": "0'0", 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_seq": 0, 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "reported_epoch": 0, 2024-09-16T03:40:45.025 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "unknown", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fresh": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_change": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_active": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_peered": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_active": "0.000000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_became_peered": "0.000000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_unstale": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_undegraded": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "last_fullsized": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "mapping_epoch": 0, 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "log_start": "0'0", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_start": "0'0", 2024-09-16T03:40:45.026 INFO:teuthology.orchestra.run.smithi138.stdout: "created": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_epoch_clean": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "parent": "0.0", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "parent_split_bits": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub": "0'0", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub": "0'0", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_deep_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "last_clean_scrub_stamp": "2024-09-16T03:40:43.500615+0000", 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_scrubbed": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "log_size": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "log_dups_size": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "ondisk_log_size": 0, 2024-09-16T03:40:45.027 INFO:teuthology.orchestra.run.smithi138.stdout: "stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "dirty_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "pin_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "manifest_stats_invalid": false, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrimq_len": 0, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "last_scrub_duration": 0, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_schedule": "--", 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_duration": 0, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "objects_trimmed": 0, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "snaptrim_duration": 0, 2024-09-16T03:40:45.028 INFO:teuthology.orchestra.run.smithi138.stdout: "stat_sum": { 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_clones": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_object_copies": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_missing": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_degraded": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_misplaced": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_unfound": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_dirty": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_whiteouts": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read": 0, 2024-09-16T03:40:45.029 INFO:teuthology.orchestra.run.smithi138.stdout: "num_read_kb": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_write_kb": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_scrub_errors": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_deep_scrub_errors": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_recovered": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_recovered": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_keys_recovered": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_omap": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_kb": 0, 2024-09-16T03:40:45.030 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_kb": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_promote": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_high": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_flush_mode_low": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_some": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_evict_mode_full": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_pinned": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_legacy_snapsets": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_large_omap_objects": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_manifest": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_bytes": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_omap_keys": 0, 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: "num_objects_repaired": 0 2024-09-16T03:40:45.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "up": [], 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "acting": [], 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "avail_no_missing": [], 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "object_location_counts": [], 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "blocked_by": [], 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "up_primary": -1, 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "acting_primary": -1, 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: "purged_snaps": [] 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-16T03:40:45.032 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-16T03:40:45.032 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T03:40:45.035 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T03:40:45.035 DEBUG:teuthology.orchestra.run.smithi138:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 1048576 -p test bench 60 write --no-cleanup' 2024-09-16T03:40:45.088 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:hints = 1 2024-09-16T03:40:45.088 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 1048576 for up to 60 seconds or 0 objects 2024-09-16T03:40:45.088 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Object prefix: benchmark_data_smithi138_27857 2024-09-16T03:40:45.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:40:45.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 0 0 0 0 0 0 - 0 2024-09-16T03:40:46.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 1 16 654 638 39.8728 39.875 0.00699552 0.0249223 2024-09-16T03:40:47.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 2 16 2595 2579 80.5876 121.312 0.00991088 0.0123698 2024-09-16T03:40:48.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 3 16 4599 4583 95.4716 125.25 0.0049984 0.010458 2024-09-16T03:40:49.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 4 15 6524 6509 101.695 120.375 0.00372619 0.00981619 2024-09-16T03:40:50.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 5 16 8221 8205 102.554 106 0.0061557 0.0097393 2024-09-16T03:40:51.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 6 16 9860 9844 102.534 102.438 0.0172824 0.00974493 2024-09-16T03:40:52.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 7 16 11336 11320 101.063 92.25 0.0103934 0.00987973 2024-09-16T03:40:53.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 8 16 12855 12839 100.297 94.9375 0.0154328 0.00996171 2024-09-16T03:40:54.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 9 16 14280 14264 99.0475 89.0625 0.0132893 0.0100821 2024-09-16T03:40:55.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 10 16 15674 15658 97.8546 87.125 0.00560477 0.0102087 2024-09-16T03:40:56.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 11 16 16989 16973 96.4297 82.1875 0.00628925 0.0103603 2024-09-16T03:40:57.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 12 16 18307 18291 95.2577 82.375 0.00496354 0.0104849 2024-09-16T03:40:58.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 13 16 19578 19562 94.0403 79.4375 0.0194521 0.0106192 2024-09-16T03:40:59.089 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 14 16 20867 20851 93.0772 80.5625 0.0135058 0.0107355 2024-09-16T03:41:00.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 15 16 22013 21997 91.6466 71.625 0.0173884 0.0109017 2024-09-16T03:41:01.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 16 16 23313 23297 90.9963 81.25 0.0107648 0.0109786 2024-09-16T03:41:02.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 17 16 24621 24605 90.452 81.75 0.0149881 0.0110447 2024-09-16T03:41:03.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 18 16 25857 25841 89.7182 77.25 0.00517143 0.0111392 2024-09-16T03:41:04.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 19 16 27092 27076 89.0584 77.1875 0.0186067 0.0112183 2024-09-16T03:41:05.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:41:05.091567+0000 min lat: 0.00167712 max lat: 0.474468 avg lat: 0.0113527 2024-09-16T03:41:05.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:41:05.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 20 16 28185 28169 88.0208 68.3125 0.0086539 0.0113527 2024-09-16T03:41:06.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 21 16 29199 29183 86.8469 63.375 0.00952751 0.0115076 2024-09-16T03:41:07.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 22 16 30368 30352 86.22 73.0625 0.00968337 0.0115905 2024-09-16T03:41:08.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 23 16 31448 31432 85.4059 67.5 0.0105569 0.0117018 2024-09-16T03:41:09.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 24 16 32550 32534 84.7167 68.875 0.0110791 0.0117976 2024-09-16T03:41:10.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 25 16 33701 33685 84.2053 71.9375 0.00505997 0.0118677 2024-09-16T03:41:11.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 26 16 34828 34812 83.6755 70.4375 0.00725429 0.0119437 2024-09-16T03:41:12.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 27 16 35906 35890 83.0716 67.375 0.00512713 0.0120301 2024-09-16T03:41:13.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 28 16 37091 37075 82.7496 74.0625 0.012418 0.0120775 2024-09-16T03:41:14.090 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 29 16 38134 38118 82.1439 65.1875 0.0121645 0.0121661 2024-09-16T03:41:15.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 30 16 39231 39215 81.691 68.5625 0.0126589 0.0122331 2024-09-16T03:41:16.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 31 16 40217 40201 81.0435 61.625 0.0216904 0.0123308 2024-09-16T03:41:17.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 32 16 41287 41271 80.6005 66.875 0.0106707 0.0124001 2024-09-16T03:41:18.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 33 16 42312 42296 80.0992 64.0625 0.0252004 0.0124789 2024-09-16T03:41:19.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 34 16 43321 43305 79.598 63.0625 0.0200908 0.0125559 2024-09-16T03:41:20.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 35 16 44315 44299 79.0986 62.125 0.0319288 0.0126356 2024-09-16T03:41:21.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 36 16 45356 45340 78.7086 65.0625 0.017579 0.0126983 2024-09-16T03:41:22.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 37 16 46346 46330 78.2535 61.875 0.0181934 0.0127722 2024-09-16T03:41:23.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 38 16 47361 47345 77.8635 63.4375 0.0190047 0.0128356 2024-09-16T03:41:24.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 39 16 48236 48220 77.2691 54.6875 0.00683217 0.0129357 2024-09-16T03:41:25.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:41:25.093278+0000 min lat: 0.00167712 max lat: 0.474468 avg lat: 0.0130008 2024-09-16T03:41:25.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:41:25.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 40 16 49223 49207 76.8795 61.6875 0.0144489 0.0130008 2024-09-16T03:41:26.091 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 41 16 50133 50117 76.3914 56.875 0.0228202 0.0130831 2024-09-16T03:41:27.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 42 16 51108 51092 76.0234 60.9375 0.0236396 0.0131481 2024-09-16T03:41:28.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 43 16 52007 51991 75.562 56.1875 0.0132418 0.0132276 2024-09-16T03:41:29.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 44 16 52937 52921 75.1656 58.125 0.0225722 0.0132974 2024-09-16T03:41:30.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 45 16 53871 53855 74.7923 58.375 0.00662621 0.0133645 2024-09-16T03:41:31.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 46 16 54761 54745 74.3755 55.625 0.0213421 0.0134376 2024-09-16T03:41:32.092 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 47 16 55625 55609 73.9419 54 0.0172325 0.0135177 2024-09-16T03:41:33.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 48 16 56511 56495 73.555 55.375 0.0219357 0.0135882 2024-09-16T03:41:34.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 49 16 57411 57395 73.2018 56.25 0.0190649 0.0136547 2024-09-16T03:41:35.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 50 16 58108 58092 72.6089 43.5625 0.0217555 0.0137655 2024-09-16T03:41:36.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 51 16 58950 58934 72.217 52.625 0.0307867 0.0138411 2024-09-16T03:41:37.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 52 16 59793 59777 71.8413 52.6875 0.0135524 0.0139126 2024-09-16T03:41:38.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 53 16 60666 60650 71.5152 54.5625 0.0355296 0.0139761 2024-09-16T03:41:39.093 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 54 16 61454 61438 71.1028 49.25 0.0159407 0.0140581 2024-09-16T03:41:40.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 55 16 62251 62235 70.7156 49.8125 0.00942668 0.0141352 2024-09-16T03:41:41.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 56 16 62994 62978 70.282 46.4375 0.0193615 0.0142223 2024-09-16T03:41:42.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 57 16 63794 63778 69.9262 50 0.00864481 0.0142931 2024-09-16T03:41:43.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 58 16 64560 64544 69.5459 47.875 0.0179609 0.0143721 2024-09-16T03:41:44.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 59 16 65335 65319 69.1881 48.4375 0.0194455 0.0144472 2024-09-16T03:41:45.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:41:45.094924+0000 min lat: 0.00167712 max lat: 0.474468 avg lat: 0.0145241 2024-09-16T03:41:45.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:41:45.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 60 14 66081 66067 68.814 46.75 0.0303794 0.0145241 2024-09-16T03:41:46.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Total time run: 60.0184 2024-09-16T03:41:46.094 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Total writes made: 66081 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Write size: 65536 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Object size: 1048576 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Bandwidth (MB/sec): 68.8132 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Stddev Bandwidth: 18.9716 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Max bandwidth (MB/sec): 125.25 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Min bandwidth (MB/sec): 39.875 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Average IOPS: 1101 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Stddev IOPS: 303.545 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Max IOPS: 2004 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Min IOPS: 638 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Average Latency(s): 0.0145268 2024-09-16T03:41:46.095 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Stddev Latency(s): 0.0100572 2024-09-16T03:41:46.096 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Max latency(s): 0.474468 2024-09-16T03:41:46.096 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Min latency(s): 0.00167712 2024-09-16T03:41:46.107 DEBUG:teuthology.orchestra.run.smithi138:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -p test bench 360 rand' 2024-09-16T03:41:46.109 INFO:tasks.radosbench:joining radosbench (timing out after 11100s) 2024-09-16T03:41:46.109 INFO:teuthology.orchestra.run:waiting for 11100 2024-09-16T03:41:46.152 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:hints = 1 2024-09-16T03:41:46.153 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:41:46.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 0 0 0 0 0 0 - 0 2024-09-16T03:41:46.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.188+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:41:46.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.196+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:41:46.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.220+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:41:46.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.224+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:41:46.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:41:46.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.248+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:41:46.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.276+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:41:46.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.280+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:41:46.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:41:46.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:41:46.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.360+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:41:46.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.364+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:41:46.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.400+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:41:46.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:41:46.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:41:46.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:41:46.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.440+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:41:46.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.452+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:41:46.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.452+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:41:46.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.472+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:41:46.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.492+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:41:46.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.500+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:41:46.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.504+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:41:46.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.524+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:41:46.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.524+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:41:46.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.524+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:41:46.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.532+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:41:46.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.560+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:41:46.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:41:46.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:41:46.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.604+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:41:46.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.608+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:41:46.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.628+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:41:46.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.632+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:41:46.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.632+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:41:46.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:41:46.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:41:46.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.656+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:41:46.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.672+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:41:46.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.672+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:41:46.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.672+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:41:46.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.688+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:41:46.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.708+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:41:46.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.708+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:41:46.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.720+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:41:46.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.736+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:41:46.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.760+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:41:46.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:41:46.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.764+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:41:46.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.772+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:41:46.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.820+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:41:46.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.820+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:41:46.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.836+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:41:46.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.836+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:41:46.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:41:46.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.856+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:41:46.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:41:46.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.880+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:41:46.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.912+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:41:46.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.912+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:41:46.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.920+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:41:46.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.928+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:41:46.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:41:46.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.952+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:41:46.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:41:46.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.984+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:41:46.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:46.988+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:41:47.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.000+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:41:47.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.012+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:41:47.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:41:47.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.036+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:41:47.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.044+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:41:47.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.052+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:41:47.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:41:47.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.072+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:41:47.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.076+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:41:47.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.108+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:41:47.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.112+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:41:47.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.116+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:41:47.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.128+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:41:47.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.140+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:41:47.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:41:47.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 1 16 12118 12102 756.273 756.375 0.000568325 0.00130689 2024-09-16T03:41:47.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:41:47.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.176+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:41:47.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.192+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:41:47.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.196+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:41:47.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.220+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:41:47.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.228+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:41:47.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.260+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:41:47.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:41:47.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:41:47.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.304+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:41:47.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.304+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:41:47.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.308+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:41:47.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:41:47.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.324+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:41:47.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.344+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:41:47.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.356+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:41:47.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.364+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:41:47.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.380+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:41:47.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.388+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:41:47.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:41:47.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.424+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:41:47.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.432+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:41:47.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.436+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:41:47.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.440+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:41:47.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.476+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:41:47.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.476+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:41:47.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.488+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:41:47.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.512+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:41:47.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.512+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:41:47.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.516+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:41:47.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:41:47.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:41:47.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.548+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:41:47.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.568+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:41:47.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.572+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:41:47.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.580+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:41:47.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.600+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:41:47.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.604+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:41:47.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:41:47.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.616+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:41:47.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:41:47.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.676+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:41:47.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.688+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:41:47.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.708+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:41:47.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.720+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:41:47.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.728+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:41:47.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:41:47.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.748+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:41:47.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.752+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:41:47.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:41:47.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.772+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:41:47.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.776+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:41:47.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.792+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:41:47.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.808+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:41:47.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.808+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:41:47.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:41:47.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:41:47.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.836+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:41:47.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.860+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:41:47.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.864+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:41:47.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.868+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:41:47.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:41:47.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.908+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:41:47.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.912+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:41:47.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:41:47.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.952+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:41:47.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.952+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:41:47.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.956+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:41:47.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.976+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:41:47.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:41:48.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:47.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:41:48.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:41:48.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.012+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:41:48.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:41:48.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:41:48.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.040+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:41:48.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.060+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:41:48.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:41:48.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.084+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:41:48.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.108+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:41:48.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:41:48.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.124+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:41:48.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 2 16 25088 25072 783.417 810.625 0.000840659 0.001264 2024-09-16T03:41:48.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:41:48.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:41:48.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:41:48.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.176+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:41:48.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.180+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:41:48.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.196+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:41:48.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.220+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:41:48.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.228+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:41:48.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.240+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:41:48.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:41:48.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.244+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:41:48.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.268+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:41:48.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.300+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:41:48.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.308+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:41:48.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:41:48.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.344+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:41:48.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.344+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:41:48.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:41:48.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.356+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:41:48.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.364+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:41:48.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.368+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:41:48.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.368+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:41:48.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.400+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:41:48.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:41:48.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.420+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:41:48.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.428+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:41:48.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.444+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:41:48.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.452+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:41:48.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:41:48.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.480+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:41:48.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.484+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:41:48.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:41:48.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:41:48.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.512+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:41:48.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.540+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:41:48.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.564+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:41:48.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:41:48.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.588+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:41:48.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.588+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:41:48.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.600+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:41:48.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:41:48.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.616+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:41:48.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.632+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:41:48.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:41:48.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:41:48.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:41:48.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.684+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:41:48.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:41:48.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.692+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:41:48.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.712+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:41:48.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.716+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:41:48.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.744+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:41:48.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.760+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:41:48.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.760+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:41:48.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.764+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:41:48.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.776+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:41:48.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.780+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:41:48.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.800+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:41:48.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.812+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:41:48.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:41:48.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.836+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:41:48.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.840+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:41:48.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.864+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:41:48.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.872+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:41:48.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.880+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:41:48.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.892+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:41:48.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.900+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:41:48.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.908+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:41:48.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.920+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:41:48.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.936+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:41:48.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.936+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:41:48.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.936+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:41:48.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.976+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:41:48.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.980+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:41:48.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.984+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:41:48.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:48.992+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:41:49.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.024+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:41:49.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.032+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:41:49.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.056+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:41:49.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:41:49.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.084+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:41:49.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:41:49.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.100+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:41:49.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.112+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:41:49.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.136+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:41:49.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 3 15 38122 38107 793.818 814.688 0.000509187 0.00124754 2024-09-16T03:41:49.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.148+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:41:49.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.168+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:41:49.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.176+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:41:49.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.192+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:41:49.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:41:49.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.232+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:41:49.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.240+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:41:49.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.260+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:41:49.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.272+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:41:49.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:41:49.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.316+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:41:49.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.320+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:41:49.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.436+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:41:49.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:41:49.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:41:49.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:41:49.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.512+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:41:49.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.524+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:41:49.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.532+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:41:49.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:41:49.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:41:49.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:41:49.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.584+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:41:49.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.600+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:41:49.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.600+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:41:49.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:41:49.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.608+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:41:49.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.616+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:41:49.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.616+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:41:49.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.628+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:41:49.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.652+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:41:49.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.668+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:41:49.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.688+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:41:49.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:41:49.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.704+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:41:49.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.716+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:41:49.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.720+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:41:49.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:41:49.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.752+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:41:49.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.752+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:41:49.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:41:49.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.772+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:41:49.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:41:49.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.792+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:41:49.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.816+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:41:49.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:41:49.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.824+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:41:49.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:41:49.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:41:49.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.872+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:41:49.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.880+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:41:49.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.888+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:41:49.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.908+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:41:49.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.924+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:41:49.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:41:49.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.932+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:41:49.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.936+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:41:49.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.964+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:41:49.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.968+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:41:49.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:41:49.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:49.992+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:41:50.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.000+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:41:50.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.004+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:41:50.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.012+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:41:50.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:41:50.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.032+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:41:50.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.052+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:41:50.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:41:50.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.080+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:41:50.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.088+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:41:50.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:41:50.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.120+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:41:50.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.132+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:41:50.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.140+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:41:50.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.144+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:41:50.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 4 16 49476 49460 772.74 709.562 0.0145412 0.00128151 2024-09-16T03:41:50.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:41:50.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.164+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:41:50.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.172+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:41:50.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.172+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:41:50.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.204+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:41:50.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.212+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:41:50.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.224+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:41:50.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.240+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:41:50.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.244+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:41:50.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:41:50.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:41:50.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:41:50.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.284+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:41:50.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.284+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:41:50.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.288+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:41:50.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.304+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:41:50.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.320+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:41:50.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.328+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:41:50.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.328+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:41:50.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.356+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:41:50.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.372+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:41:50.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.376+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:41:50.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.392+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:41:50.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.396+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:41:50.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.408+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:41:50.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:41:50.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.436+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:41:50.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.436+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:41:50.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.452+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:41:50.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.460+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:41:50.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.464+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:41:50.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.496+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:41:50.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.496+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:41:50.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.504+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:41:50.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.512+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:41:50.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.512+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:41:50.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.520+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:41:50.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:41:50.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.540+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:41:50.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:41:50.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.572+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:41:50.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:41:50.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.592+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:41:50.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.608+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:41:50.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.612+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:41:50.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.616+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:41:50.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.616+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:41:50.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.652+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:41:50.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.680+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:41:50.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.680+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:41:50.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.708+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:41:50.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.708+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:41:50.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.712+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:41:50.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.736+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:41:50.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.736+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:41:50.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.740+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:41:50.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:41:50.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.768+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:41:50.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.768+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:41:50.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.808+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:41:50.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:41:50.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.828+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:41:50.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.836+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:41:50.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.836+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:41:50.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.848+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:41:50.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.892+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:41:50.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.896+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:41:50.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.900+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:41:50.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.900+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:41:50.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.916+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:41:50.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.928+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:41:50.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.936+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:41:50.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:41:50.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.960+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:41:50.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:41:50.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.980+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:41:50.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:41:50.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:41:51.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:50.996+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:41:51.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:41:51.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:41:51.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.044+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:41:51.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:41:51.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.112+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:41:51.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.124+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:41:51.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:41:51.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.140+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:41:51.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.148+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:41:51.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 5 16 62558 62542 781.702 817.625 0.00373201 0.00126675 2024-09-16T03:41:51.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.172+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:41:51.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.188+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:41:51.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.204+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:41:51.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.208+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:41:51.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.224+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:41:51.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.232+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:41:51.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.236+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:41:51.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:41:51.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.240+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:41:51.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:41:51.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:41:51.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.292+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:41:51.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.300+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:41:51.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.300+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:41:51.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.308+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:41:51.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:41:51.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.316+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:41:51.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.344+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:41:51.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.348+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:41:51.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.376+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:41:51.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.376+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:41:51.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.376+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:41:51.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.392+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:41:51.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:41:51.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:41:51.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.432+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:41:51.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.444+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:41:51.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.448+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:41:51.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.456+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:41:51.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.464+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:41:51.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.472+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:41:51.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:41:51.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.516+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:41:51.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.520+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:41:51.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.520+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:41:51.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.532+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:41:51.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:41:51.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.564+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:41:51.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.564+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:41:51.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.572+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:41:51.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.576+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:41:51.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.600+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:41:51.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.608+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:41:51.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:41:51.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.644+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:41:51.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.664+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:41:51.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.664+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:41:51.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.668+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:41:51.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.700+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:41:51.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.700+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:41:51.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.700+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:41:51.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.728+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:41:51.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.736+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:41:51.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.740+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:41:51.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.756+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:41:51.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.760+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:41:51.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.776+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:41:51.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.776+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:41:51.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.788+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:41:51.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.800+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:41:51.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.816+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:41:51.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.828+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:41:51.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.828+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:41:51.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.832+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:41:51.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.864+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:41:51.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.868+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:41:51.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:41:51.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.884+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:41:51.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.896+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:41:51.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.896+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:41:51.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:41:51.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.924+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:41:51.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.960+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:41:51.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.972+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:41:51.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:51.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:41:52.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:41:52.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:41:52.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.020+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:41:52.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:41:52.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.036+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:41:52.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.048+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:41:52.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.056+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:41:52.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.076+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:41:52.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.084+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:41:52.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.088+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:41:52.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:41:52.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.112+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:41:52.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:41:52.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:41:52.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:41:52.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 6 16 75647 75631 787.751 818.062 0.000748183 0.00125716 2024-09-16T03:41:52.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.164+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:41:52.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.180+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:41:52.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.200+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:41:52.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.200+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:41:52.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.220+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:41:52.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.248+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:41:52.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.264+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:41:52.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.264+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:41:52.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.280+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:41:52.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.280+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:41:52.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.284+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:41:52.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.308+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:41:52.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.308+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:41:52.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.328+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:41:52.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:41:52.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.344+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:41:52.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.356+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:41:52.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.384+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:41:52.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:41:52.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.424+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:41:52.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.460+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:41:52.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.460+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:41:52.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.472+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:41:52.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:41:52.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.484+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:41:52.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.500+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:41:52.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.504+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:41:52.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.504+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:41:52.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.520+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:41:52.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:41:52.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.548+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:41:52.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.556+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:41:52.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:41:52.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:41:52.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:41:52.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.644+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:41:52.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.656+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:41:52.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.676+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:41:52.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.688+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:41:52.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:41:52.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.708+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:41:52.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.708+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:41:52.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.732+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:41:52.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.732+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:41:52.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.744+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:41:52.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.756+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:41:52.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.764+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:41:52.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.772+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:41:52.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.784+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:41:52.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.784+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:41:52.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.784+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:41:52.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.824+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:41:52.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.828+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:41:52.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.848+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:41:52.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.880+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:41:52.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.888+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:41:52.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:41:52.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.908+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:41:52.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.928+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:41:52.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.948+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:41:52.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.948+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:41:52.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.952+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:41:52.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:41:52.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:52.992+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:41:53.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:41:53.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.004+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:41:53.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.020+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:41:53.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.024+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:41:53.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.040+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:41:53.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.040+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:41:53.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.060+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:41:53.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.064+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:41:53.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.080+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:41:53.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.084+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:41:53.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.100+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:41:53.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.128+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:41:53.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.132+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:41:53.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.144+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:41:53.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 7 15 88954 88939 794.024 831.75 0.00113488 0.00124723 2024-09-16T03:41:53.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.160+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:41:53.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.168+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:41:53.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.188+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:41:53.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.188+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:41:53.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:41:53.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.228+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:41:53.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.228+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:41:53.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:41:53.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.248+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:41:53.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.256+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:41:53.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:41:53.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.276+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:41:53.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.280+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:41:53.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.316+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:41:53.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.324+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:41:53.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.324+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:41:53.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.372+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:41:53.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.380+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:41:53.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.412+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:41:53.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:41:53.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:41:53.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.440+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:41:53.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:41:53.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.464+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:41:53.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.476+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:41:53.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.496+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:41:53.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:41:53.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.516+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:41:53.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:41:53.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.528+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:41:53.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.532+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:41:53.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.536+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:41:53.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.552+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:41:53.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.568+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:41:53.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.584+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:41:53.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.588+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:41:53.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.600+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:41:53.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.608+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:41:53.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.620+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:41:53.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.656+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:41:53.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.664+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:41:53.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.676+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:41:53.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.680+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:41:53.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.688+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:41:53.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.692+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:41:53.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.704+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:41:53.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.736+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:41:53.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.752+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:41:53.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:41:53.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.772+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:41:53.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.780+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:41:53.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:41:53.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.800+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:41:53.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.820+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:41:53.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:41:53.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.824+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:41:53.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.844+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:41:53.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.864+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:41:53.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.876+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:41:53.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.888+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:41:53.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.896+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:41:53.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:41:53.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:41:53.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.936+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:41:53.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.956+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:41:53.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.964+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:41:53.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:53.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:41:54.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.000+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:41:54.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.000+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:41:54.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.008+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:41:54.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.012+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:41:54.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.024+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:41:54.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.044+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:41:54.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.052+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:41:54.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:41:54.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.072+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:41:54.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.096+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:41:54.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.100+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:41:54.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.108+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:41:54.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.124+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:41:54.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.136+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:41:54.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 8 16 102365 102349 799.528 838.125 0.000959604 0.00123838 2024-09-16T03:41:54.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:41:54.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.184+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:41:54.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.196+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:41:54.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.196+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:41:54.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.236+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:41:54.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.252+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:41:54.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:41:54.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.268+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:41:54.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:41:54.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.276+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:41:54.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.288+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:41:54.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.320+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:41:54.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.332+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:41:54.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.340+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:41:54.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.344+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:41:54.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.348+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:41:54.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.364+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:41:54.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.376+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:41:54.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.380+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:41:54.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.392+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:41:54.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:41:54.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.428+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:41:54.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.440+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:41:54.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:41:54.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.468+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:41:54.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:41:54.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.476+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:41:54.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.488+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:41:54.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.500+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:41:54.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.500+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:41:54.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.508+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:41:54.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:41:54.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.540+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:41:54.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:41:54.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:41:54.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.560+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:41:54.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.564+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:41:54.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:41:54.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.584+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:41:54.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.588+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:41:54.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.596+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:41:54.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:41:54.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.644+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:41:54.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.660+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:41:54.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.660+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:41:54.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:41:54.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.684+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:41:54.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.700+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:41:54.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:41:54.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.704+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:41:54.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.736+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:41:54.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.744+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:41:54.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.756+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:41:54.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.764+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:41:54.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:41:54.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.784+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:41:54.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.792+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:41:54.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.804+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:41:54.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.808+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:41:54.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.836+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:41:54.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.840+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:41:54.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:41:54.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.852+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:41:54.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.868+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:41:54.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.888+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:41:54.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.888+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:41:54.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.888+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:41:54.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.920+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:41:54.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:41:54.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.932+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:41:54.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.948+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:41:54.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.960+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:41:54.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.964+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:41:54.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:41:54.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.988+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:41:54.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:54.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:41:55.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.012+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:41:55.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.040+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:41:55.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.060+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:41:55.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.064+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:41:55.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.064+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:41:55.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.072+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:41:55.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:41:55.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:41:55.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.120+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:41:55.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.124+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:41:55.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.140+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:41:55.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.144+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:41:55.154 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 9 15 115699 115684 803.283 833.438 0.00101442 0.00123267 2024-09-16T03:41:55.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.152+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:41:55.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.160+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:41:55.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.168+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:41:55.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:41:55.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:41:55.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.204+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:41:55.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:41:55.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.240+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:41:55.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.240+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:41:55.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:41:55.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:41:55.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.292+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:41:55.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.304+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:41:55.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:41:55.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.312+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:41:55.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.320+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:41:55.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:41:55.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.356+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:41:55.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.380+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:41:55.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.412+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:41:55.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:41:55.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.428+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:41:55.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.444+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:41:55.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.464+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:41:55.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.468+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:41:55.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.480+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:41:55.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.500+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:41:55.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.520+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:41:55.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:41:55.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.544+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:41:55.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.560+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:41:55.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.568+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:41:55.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.572+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:41:55.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.580+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:41:55.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.584+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:41:55.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.600+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:41:55.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:41:55.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.616+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:41:55.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.624+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:41:55.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.640+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:41:55.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.680+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:41:55.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.692+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:41:55.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.696+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:41:55.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:41:55.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.704+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:41:55.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:41:55.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.728+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:41:55.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.736+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:41:55.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.740+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:41:55.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:41:55.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.764+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:41:55.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.800+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:41:55.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.820+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:41:55.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:41:55.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.844+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:41:55.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.852+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:41:55.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.876+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:41:55.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.888+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:41:55.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:41:55.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.912+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:41:55.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.920+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:41:55.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:41:55.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.952+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:41:55.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.964+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:41:55.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.972+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:41:55.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.976+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:41:55.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.976+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:41:55.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:55.996+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:41:56.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.000+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:41:56.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.008+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:41:56.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.044+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:41:56.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.060+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:41:56.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.060+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:41:56.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.076+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:41:56.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.076+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:41:56.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.112+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:41:56.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.120+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:41:56.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.132+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:41:56.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.144+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:41:56.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:41:56.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.152+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:41:56.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 10 16 129128 129112 806.873 839.25 0.000791151 0.0012272 2024-09-16T03:41:56.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.176+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:41:56.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.176+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:41:56.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.184+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:41:56.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.200+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:41:56.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:41:56.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.212+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:41:56.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.224+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:41:56.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.228+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:41:56.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.240+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:41:56.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:41:56.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.248+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:41:56.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:41:56.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.268+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:41:56.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:41:56.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:41:56.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.304+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:41:56.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.336+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:41:56.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.352+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:41:56.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.356+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:41:56.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:41:56.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.376+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:41:56.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.404+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:41:56.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:41:56.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.440+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:41:56.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.440+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:41:56.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:41:56.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.464+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:41:56.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.472+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:41:56.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.472+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:41:56.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.500+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:41:56.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.516+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:41:56.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:41:56.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.532+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:41:56.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.556+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:41:56.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:41:56.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.572+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:41:56.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.584+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:41:56.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.604+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:41:56.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:41:56.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:41:56.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.628+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:41:56.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.632+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:41:56.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:41:56.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:41:56.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.664+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:41:56.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.668+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:41:56.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.680+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:41:56.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.696+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:41:56.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.712+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:41:56.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.716+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:41:56.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.728+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:41:56.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.744+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:41:56.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.752+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:41:56.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.768+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:41:56.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.780+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:41:56.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.800+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:41:56.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.820+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:41:56.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.828+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:41:56.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.832+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:41:56.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:41:56.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.860+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:41:56.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.872+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:41:56.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:41:56.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:41:56.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.908+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:41:56.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.920+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:41:56.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.924+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:41:56.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:41:56.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.956+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:41:56.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.968+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:41:56.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.968+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:41:56.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.980+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:41:56.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:56.996+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:41:57.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.008+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:41:57.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.016+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:41:57.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.036+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:41:57.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.040+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:41:57.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.048+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:41:57.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:41:57.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.080+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:41:57.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.088+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:41:57.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.088+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:41:57.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.092+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:41:57.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.100+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:41:57.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.124+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:41:57.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.152+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:41:57.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 11 16 142319 142303 808.463 824.438 0.000657572 0.00122489 2024-09-16T03:41:57.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.164+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:41:57.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.168+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:41:57.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.172+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:41:57.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.188+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:41:57.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:41:57.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.192+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:41:57.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.216+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:41:57.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.252+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:41:57.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:41:57.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.256+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:41:57.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.268+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:41:57.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:41:57.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.284+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:41:57.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.312+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:41:57.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.320+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:41:57.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.340+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:41:57.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:41:57.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.352+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:41:57.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.360+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:41:57.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.372+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:41:57.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.376+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:41:57.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.404+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:41:57.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.404+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:41:57.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.412+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:41:57.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:41:57.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.440+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:41:57.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.448+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:41:57.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:41:57.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.464+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:41:57.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.472+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:41:57.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.476+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:41:57.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.504+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:41:57.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.524+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:41:57.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.528+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:41:57.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.540+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:41:57.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:41:57.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:41:57.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.552+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:41:57.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.568+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:41:57.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:41:57.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.592+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:41:57.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.616+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:41:57.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:41:57.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.636+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:41:57.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.636+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:41:57.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.652+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:41:57.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.656+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:41:57.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.660+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:41:57.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.668+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:41:57.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:41:57.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.684+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:41:57.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.688+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:41:57.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:41:57.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.720+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:41:57.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.724+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:41:57.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.736+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:41:57.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.752+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:41:57.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:41:57.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.772+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:41:57.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:41:57.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.784+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:41:57.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.804+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:41:57.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.820+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:41:57.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.832+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:41:57.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:41:57.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:41:57.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.852+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:41:57.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.852+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:41:57.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:41:57.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:41:57.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.900+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:41:57.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.924+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:41:57.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.928+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:41:57.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:41:57.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.948+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:41:57.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.956+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:41:57.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.964+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:41:57.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:41:57.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:57.984+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:41:58.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.024+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:41:58.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.024+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:41:58.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.028+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:41:58.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.032+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:41:58.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.084+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:41:58.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.088+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:41:58.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.096+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:41:58.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:41:58.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.108+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:41:58.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.124+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:41:58.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.152+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:41:58.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 12 16 155199 155183 808.169 805 0.00180116 0.00122533 2024-09-16T03:41:58.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.156+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:41:58.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:41:58.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:41:58.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.176+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:41:58.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.188+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:41:58.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:41:58.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.208+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:41:58.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.208+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:41:58.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.212+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:41:58.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.216+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:41:58.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.248+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:41:58.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.248+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:41:58.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:41:58.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.284+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:41:58.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.292+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:41:58.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:41:58.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.312+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:41:58.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.320+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:41:58.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.324+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:41:58.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.340+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:41:58.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.344+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:41:58.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.348+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:41:58.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:41:58.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.364+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:41:58.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.380+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:41:58.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.388+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:41:58.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.392+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:41:58.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.408+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:41:58.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:41:58.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.432+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:41:58.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.448+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:41:58.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.452+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:41:58.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.456+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:41:58.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.464+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:41:58.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.476+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:41:58.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:41:58.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.488+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:41:58.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.496+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:41:58.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.508+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:41:58.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.516+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:41:58.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.520+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:41:58.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.564+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:41:58.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.584+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:41:58.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.584+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:41:58.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.596+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:41:58.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.596+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:41:58.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.608+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:41:58.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.620+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:41:58.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.636+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:41:58.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.664+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:41:58.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.668+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:41:58.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.672+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:41:58.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.672+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:41:58.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.688+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:41:58.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.744+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:41:58.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:41:58.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.776+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:41:58.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.780+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:41:58.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.800+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:41:58.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.800+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:41:58.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.804+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:41:58.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:41:58.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.840+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:41:58.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.852+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:41:58.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.868+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:41:58.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:41:58.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.880+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:41:58.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.896+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:41:58.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:41:58.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.912+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:41:58.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.932+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:41:58.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.932+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:41:58.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.932+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:41:58.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.952+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:41:58.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.956+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:41:58.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.960+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:41:58.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.964+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:41:58.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:58.980+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:41:59.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.008+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:41:59.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.020+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:41:59.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.020+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:41:59.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.028+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:41:59.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.028+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:41:59.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.036+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:41:59.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.064+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:41:59.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.076+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:41:59.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.092+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:41:59.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.092+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:41:59.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.100+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:41:59.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.128+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:41:59.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.128+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:41:59.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 13 16 167876 167860 806.944 792.312 0.000667604 0.00122675 2024-09-16T03:41:59.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:41:59.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.160+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:41:59.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.164+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:41:59.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:41:59.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.184+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:41:59.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.188+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:41:59.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.212+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:41:59.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.224+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:41:59.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.228+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:41:59.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.240+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:41:59.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.244+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:41:59.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.260+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:41:59.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.272+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:41:59.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.276+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:41:59.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.296+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:41:59.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.296+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:41:59.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:41:59.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.340+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:41:59.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.352+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:41:59.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.356+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:41:59.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.364+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:41:59.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.372+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:41:59.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.392+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:41:59.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.420+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:41:59.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:41:59.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.432+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:41:59.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.484+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:41:59.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.488+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:41:59.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.516+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:41:59.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:41:59.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.536+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:41:59.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:41:59.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.548+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:41:59.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:41:59.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:41:59.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:41:59.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.632+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:41:59.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.644+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:41:59.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.668+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:41:59.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.672+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:41:59.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.672+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:41:59.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.700+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:41:59.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.732+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:41:59.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.748+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:41:59.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.752+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:41:59.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:41:59.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.780+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:41:59.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.804+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:41:59.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.816+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:41:59.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.824+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:41:59.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:41:59.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.844+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:41:59.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.848+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:41:59.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.884+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:41:59.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.900+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:41:59.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.912+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:41:59.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.924+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:41:59.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.928+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:41:59.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.932+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:41:59.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.944+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:41:59.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.964+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:41:59.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.988+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:41:59.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:41:59.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:00.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:42:00.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.020+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:42:00.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:42:00.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.056+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:42:00.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.056+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:42:00.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:42:00.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:00.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.100+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:00.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.112+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:42:00.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.124+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:00.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.132+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:00.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.136+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:00.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:00.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 14 16 180352 180336 804.996 779.75 0.000662363 0.00123005 2024-09-16T03:42:00.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.160+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:42:00.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.172+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:42:00.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:00.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.204+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:00.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.216+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:00.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:42:00.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.224+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:00.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.248+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:42:00.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:42:00.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.260+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:42:00.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.280+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:42:00.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.292+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:42:00.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:00.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.320+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:42:00.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.324+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:42:00.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.336+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:00.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.340+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:42:00.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.356+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:42:00.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:00.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.376+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:42:00.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.388+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:00.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.400+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:00.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:42:00.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.416+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:00.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:42:00.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.424+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:00.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.428+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:42:00.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:42:00.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:42:00.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.500+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:42:00.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.516+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:42:00.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.524+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:00.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:42:00.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.560+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:42:00.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.560+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:00.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.580+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:00.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:00.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:42:00.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.604+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:42:00.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.608+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:42:00.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.612+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:42:00.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.632+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:42:00.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:00.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:42:00.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.664+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:00.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:00.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.700+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:42:00.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.708+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:00.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.716+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:00.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.732+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:42:00.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.732+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:00.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:00.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.772+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:00.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.776+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:42:00.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.808+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:42:00.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.808+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:42:00.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.816+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:42:00.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:00.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:42:00.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.864+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:42:00.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.868+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:42:00.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.896+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:42:00.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.896+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:00.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.920+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:00.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:00.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.936+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:42:00.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:42:00.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:42:00.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.940+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:00.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:42:00.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.980+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:42:00.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.984+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:42:00.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:00.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:01.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.000+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:01.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:42:01.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.044+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:42:01.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.044+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:01.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.044+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:42:01.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.048+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:42:01.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.072+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:01.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.076+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:42:01.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.088+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:42:01.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.100+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:42:01.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.100+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:42:01.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.120+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:42:01.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.124+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:42:01.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:01.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 15 16 192983 192967 803.954 789.438 0.000981477 0.00123188 2024-09-16T03:42:01.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.156+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:42:01.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.176+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:42:01.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.184+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:42:01.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.212+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:01.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.220+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:42:01.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:42:01.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.224+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:42:01.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.236+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:42:01.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.276+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:42:01.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.292+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:42:01.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.312+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:42:01.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:01.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.328+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:42:01.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.340+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:01.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.344+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:01.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.352+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:01.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.352+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:01.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.384+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:01.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.396+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:42:01.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.412+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:42:01.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:42:01.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.428+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:42:01.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:42:01.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:42:01.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.480+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:01.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:42:01.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.500+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:42:01.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.504+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:42:01.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.512+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:42:01.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.532+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:42:01.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.540+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:42:01.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:42:01.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.560+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:01.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.572+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:01.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.576+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:01.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:42:01.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.596+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:42:01.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.612+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:01.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.636+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:01.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.652+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:42:01.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.660+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:42:01.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.668+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:42:01.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:01.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.696+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:42:01.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.696+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:42:01.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:42:01.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.716+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:01.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.736+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:42:01.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.740+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:42:01.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.748+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:42:01.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.760+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:42:01.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.776+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:42:01.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.792+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:42:01.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.792+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:01.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.816+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:01.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.824+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:01.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.840+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:42:01.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.852+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:01.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.852+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:42:01.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.864+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:42:01.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.872+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:01.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.872+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:01.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.884+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:01.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.888+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:01.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:01.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.924+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:01.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.928+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:42:01.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.944+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:42:01.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.980+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:01.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.980+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:42:01.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:42:01.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:01.996+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:42:02.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:42:02.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.012+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:42:02.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:42:02.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.040+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:02.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.044+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:02.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:42:02.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.072+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:42:02.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.076+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:42:02.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.088+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:02.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.096+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:42:02.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.100+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:42:02.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.104+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:42:02.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.132+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:02.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.140+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:42:02.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:42:02.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 16 15 206276 206261 805.632 830.875 0.000657011 0.00122925 2024-09-16T03:42:02.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.164+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:42:02.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.180+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:42:02.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.204+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:02.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:42:02.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.228+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:42:02.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.228+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:42:02.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.259+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:42:02.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:42:02.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.271+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:42:02.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.283+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:42:02.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.291+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:42:02.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.303+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:42:02.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.303+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:02.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.327+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:42:02.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.355+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:42:02.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.367+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:02.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.367+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:42:02.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.395+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:42:02.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.411+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:42:02.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.415+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:42:02.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.427+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:02.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.431+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:02.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:42:02.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.447+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:42:02.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.467+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:02.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.467+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:02.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:42:02.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.491+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:02.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.503+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:02.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.519+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:42:02.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.527+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:42:02.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:42:02.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.531+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:42:02.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.563+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:02.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.575+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:42:02.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.575+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:42:02.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.587+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:42:02.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.595+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:42:02.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.603+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:42:02.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:42:02.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.627+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:42:02.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.635+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:42:02.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:02.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.647+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:42:02.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.667+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:02.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.675+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:02.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.679+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:02.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.695+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:42:02.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.707+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:02.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.711+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:42:02.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.723+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:42:02.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.723+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:02.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:02.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.739+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:42:02.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.767+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:42:02.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:02.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.783+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:42:02.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.787+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:02.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.795+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:42:02.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:02.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.823+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:02.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.831+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:42:02.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.839+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:02.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.839+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:42:02.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.839+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:42:02.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.867+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:02.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.895+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:42:02.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:42:02.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.903+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:42:02.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.911+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:42:02.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:02.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.935+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:42:02.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.939+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:42:02.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.943+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:02.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.947+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:42:02.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.955+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:42:02.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.983+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:42:02.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.991+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:42:03.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:02.999+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:03.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.003+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:42:03.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.019+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:42:03.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.023+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:42:03.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.031+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:03.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:42:03.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.067+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:42:03.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.075+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:03.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.079+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:03.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:42:03.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.111+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:03.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:42:03.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.131+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:42:03.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 17 16 219268 219252 805.999 811.938 0.000892234 0.00122872 2024-09-16T03:42:03.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.155+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:03.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.167+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:42:03.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.167+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:03.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.191+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:42:03.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:42:03.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.215+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:03.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:42:03.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.259+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:03.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.259+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:03.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.263+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:42:03.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.267+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:42:03.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.279+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:03.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.283+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:03.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.287+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:42:03.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.295+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:03.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.311+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:03.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:42:03.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.335+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:42:03.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:03.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:42:03.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.359+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:42:03.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.379+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:42:03.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.379+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:42:03.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.387+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:03.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.399+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:42:03.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:03.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.419+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:42:03.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.431+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:03.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.443+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:03.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.451+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:42:03.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.475+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:42:03.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.491+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:42:03.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.495+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:03.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.511+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:42:03.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.519+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:42:03.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.543+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:03.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.547+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:42:03.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:03.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.587+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:42:03.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:03.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:42:03.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.611+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:03.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:42:03.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.647+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:42:03.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.655+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:03.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.659+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:03.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.663+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:42:03.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.667+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:03.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:42:03.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.691+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:42:03.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.695+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:42:03.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.695+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:42:03.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.715+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:42:03.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.731+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:42:03.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:42:03.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.759+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:03.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.771+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:42:03.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.775+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:03.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.787+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:42:03.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.811+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:42:03.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.847+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:42:03.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.847+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:42:03.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:42:03.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.871+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:42:03.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:03.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.887+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:42:03.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.891+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:42:03.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.911+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:42:03.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.923+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:03.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.923+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:42:03.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.935+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:03.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.943+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:03.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.943+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:42:03.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.975+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:03.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.987+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:03.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:03.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:42:04.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.015+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:04.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.035+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:04.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.055+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:42:04.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.071+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:42:04.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.071+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:42:04.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:04.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.095+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:42:04.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.123+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:42:04.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.127+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:42:04.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.131+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:04.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.131+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:42:04.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.143+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:04.155 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 18 16 232337 232321 806.596 816.812 0.00084216 0.00122749 2024-09-16T03:42:04.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.163+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:04.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:42:04.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.183+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:04.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.183+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:42:04.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:42:04.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.199+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:42:04.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:42:04.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.231+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:42:04.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.251+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:04.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.263+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:04.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.271+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:04.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:42:04.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.287+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:42:04.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.295+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:42:04.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.315+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:42:04.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.319+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:04.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.327+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:42:04.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.347+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:04.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.351+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:04.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.375+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:42:04.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:42:04.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.403+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:42:04.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.411+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:04.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:04.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.431+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:04.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.451+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:42:04.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.455+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:42:04.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.459+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:42:04.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.467+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:42:04.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.487+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:42:04.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.499+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:04.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.523+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:42:04.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.527+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:42:04.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:42:04.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.559+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:04.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.567+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:42:04.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.571+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:04.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.575+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:04.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.587+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:42:04.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.599+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:42:04.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.647+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:42:04.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.659+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:42:04.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.667+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:42:04.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.667+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:04.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.683+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:04.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.695+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:04.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:42:04.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.707+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:42:04.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.711+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:42:04.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.715+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:42:04.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:04.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:42:04.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.743+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:04.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.767+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:42:04.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:42:04.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:04.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:04.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:04.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.815+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:04.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.835+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:42:04.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.839+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:42:04.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.871+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:42:04.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.871+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:42:04.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.883+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:42:04.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.895+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:42:04.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.915+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:42:04.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.915+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:42:04.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.923+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:42:04.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.935+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:42:04.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.947+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:42:04.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:42:04.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.967+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:04.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:04.983+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:42:05.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.015+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:42:05.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.019+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:05.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.027+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:42:05.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.039+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:42:05.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.039+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:42:05.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.043+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:05.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.055+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:42:05.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.063+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:42:05.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.079+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:05.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:05.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:42:05.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.131+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:42:05.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.135+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:42:05.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 19 16 245492 245476 807.413 822.188 0.00111952 0.00122635 2024-09-16T03:42:05.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:42:05.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.159+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:05.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.159+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:42:05.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.171+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:05.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.191+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:42:05.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.215+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:05.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.219+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:42:05.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.239+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:42:05.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.255+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:42:05.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.263+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:42:05.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.263+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:05.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.279+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:42:05.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.287+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:05.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.311+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:05.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.311+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:42:05.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.315+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:42:05.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.331+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:42:05.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.343+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:05.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.351+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:42:05.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:42:05.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:42:05.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:05.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.399+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:42:05.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.423+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:42:05.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.431+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:42:05.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.431+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:42:05.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.447+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:42:05.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:42:05.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:05.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:42:05.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.483+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:05.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.507+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:42:05.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.511+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:42:05.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.535+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:42:05.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.535+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:42:05.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.543+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:05.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.547+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:42:05.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.559+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:42:05.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.559+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:42:05.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:05.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.599+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:05.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.599+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:42:05.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.607+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:42:05.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:42:05.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.639+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:42:05.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.643+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:05.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.671+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:05.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.675+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:42:05.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.695+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:42:05.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.703+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:42:05.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.715+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:42:05.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.723+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:05.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:05.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.739+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:42:05.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.755+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:42:05.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.771+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:42:05.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.787+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:42:05.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.799+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:42:05.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.811+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:42:05.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.823+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:42:05.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.831+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:42:05.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.839+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:42:05.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.847+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:05.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.847+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:42:05.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.855+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:05.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:42:05.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.891+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:42:05.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.903+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:42:05.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.915+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:42:05.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.935+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:42:05.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.939+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:05.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.939+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:42:05.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.955+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:05.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.959+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:42:05.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:05.987+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:42:06.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.019+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:06.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.027+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:06.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.043+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:42:06.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:06.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.059+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:06.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.075+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:42:06.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:42:06.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.123+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:42:06.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.131+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:42:06.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:42:06.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.135+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:42:06.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.143+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:06.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:42:06.156212+0000 min lat: 0.000239237 max lat: 0.0720085 avg lat: 0.00122482 2024-09-16T03:42:06.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:42:06.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 20 16 258739 258723 808.435 827.938 0.000701402 0.00122482 2024-09-16T03:42:06.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.171+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:06.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.179+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:42:06.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.211+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:06.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.215+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:06.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.219+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:06.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.231+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:06.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.235+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:42:06.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:42:06.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.243+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:06.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.275+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:42:06.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.275+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:42:06.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:06.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:06.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.327+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:42:06.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.331+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:42:06.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.335+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:06.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.351+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:06.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.359+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:42:06.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:06.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.359+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:06.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.371+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:42:06.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.387+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:42:06.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.395+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:42:06.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.395+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:42:06.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:42:06.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:42:06.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.427+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:06.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.455+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:06.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.459+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:06.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.471+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:42:06.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.483+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:42:06.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.487+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:42:06.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.491+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:42:06.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.511+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:06.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.511+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:06.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.515+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:42:06.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.543+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:42:06.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.543+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:42:06.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.547+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:42:06.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.551+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:42:06.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.555+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:42:06.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.571+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:42:06.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:42:06.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.627+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:06.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.631+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:42:06.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.643+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:42:06.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.667+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:06.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.671+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:42:06.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:42:06.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.679+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:42:06.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.707+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:42:06.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:42:06.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:42:06.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.743+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:06.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.771+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:42:06.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.783+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:42:06.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.795+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:42:06.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.799+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:06.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.827+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:42:06.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.827+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:42:06.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.847+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:06.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.847+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:06.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.851+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:06.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.855+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:42:06.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.867+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:06.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.887+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:42:06.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.907+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:42:06.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.911+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:06.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.911+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:42:06.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.927+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:06.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.935+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:42:06.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.939+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:42:06.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.939+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:42:06.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.951+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:06.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.975+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:42:06.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:06.987+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:07.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.011+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:42:07.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.011+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:42:07.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.035+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:07.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.047+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:07.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.047+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:07.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.051+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:42:07.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.083+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:07.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.091+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:42:07.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.099+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:42:07.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.111+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:42:07.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.139+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:42:07.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.151+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:07.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 21 16 271791 271775 808.78 815.75 0.00120309 0.0012245 2024-09-16T03:42:07.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.155+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:42:07.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.159+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:42:07.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.163+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:42:07.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.187+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:07.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:42:07.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.211+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:42:07.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:42:07.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.231+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:42:07.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.247+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:42:07.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.247+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:42:07.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.279+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:07.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.303+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:07.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.311+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:42:07.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.319+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:42:07.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.327+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:42:07.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:42:07.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:42:07.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.355+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:07.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.355+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:42:07.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.363+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:07.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.371+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:07.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:42:07.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.387+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:42:07.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:42:07.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.443+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:07.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.455+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:42:07.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.459+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:42:07.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:07.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.495+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:07.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.503+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:42:07.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.519+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:42:07.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:42:07.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.539+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:42:07.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.567+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:42:07.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.567+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:42:07.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:42:07.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.603+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:07.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.619+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:07.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.643+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:07.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.651+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:07.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.671+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:42:07.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.675+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:42:07.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.675+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:07.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.695+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:07.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.703+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:07.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.707+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:42:07.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.715+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:42:07.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.723+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:42:07.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.735+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:42:07.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:07.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.767+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:42:07.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.767+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:07.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.783+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:42:07.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:42:07.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.791+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:07.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.803+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:07.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.815+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:07.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.823+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:07.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:42:07.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.859+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:42:07.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.863+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:07.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.887+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:07.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.887+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:42:07.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.907+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:07.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:42:07.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.915+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:42:07.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.923+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:42:07.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.927+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:42:07.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:42:07.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.963+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:42:07.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.983+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:42:07.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:07.987+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:08.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.003+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:42:08.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.007+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:08.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.019+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:08.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.035+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:08.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.035+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:42:08.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.039+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:42:08.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:08.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.059+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:08.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.067+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:42:08.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:08.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.091+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:42:08.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.107+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:08.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.111+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:42:08.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:08.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.143+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:08.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 22 15 284770 284755 808.889 811.25 0.00075177 0.00122431 2024-09-16T03:42:08.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.159+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:42:08.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.167+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:42:08.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.171+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:08.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:42:08.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.179+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:08.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.207+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:08.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.211+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:42:08.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.239+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:08.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:42:08.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.255+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:08.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.267+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:42:08.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:42:08.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.299+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:42:08.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.315+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:08.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.315+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:08.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.327+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:08.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.339+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:42:08.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.363+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:08.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:42:08.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.387+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:42:08.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:42:08.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:42:08.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.391+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:42:08.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.395+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:42:08.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.407+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:42:08.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:42:08.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.431+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:42:08.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.431+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:08.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.439+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:42:08.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.447+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:42:08.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.451+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:42:08.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.483+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:42:08.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.483+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:42:08.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.495+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:42:08.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:08.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.515+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:42:08.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.523+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:42:08.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.535+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:42:08.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.539+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:42:08.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.539+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:08.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.551+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:42:08.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.563+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:42:08.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.571+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:08.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.603+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:42:08.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.607+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:42:08.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:08.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.619+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:42:08.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.627+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:42:08.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:08.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.659+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:42:08.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.663+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:42:08.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.671+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:42:08.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.675+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:42:08.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.691+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:08.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.699+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:08.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.711+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:42:08.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.715+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:08.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.719+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:08.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.723+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:42:08.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.735+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:08.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.751+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:08.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.771+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:08.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.775+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:42:08.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.779+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:08.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:42:08.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.795+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:08.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.799+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:42:08.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.823+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:08.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.843+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:42:08.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.843+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:42:08.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.851+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:08.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.863+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:08.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.871+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:08.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.899+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:42:08.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.907+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:08.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:42:08.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.915+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:42:08.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.939+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:42:08.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.947+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:42:08.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.955+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:42:08.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.963+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:08.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.983+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:08.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.987+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:08.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:08.991+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:42:09.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.015+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:09.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:42:09.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.019+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:09.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.031+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:42:09.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.031+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:09.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.063+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:42:09.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.075+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:42:09.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.079+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:42:09.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.079+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:42:09.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.095+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:42:09.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:09.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.123+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:09.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.131+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:09.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.135+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:42:09.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:09.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.151+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:09.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 23 15 297728 297713 808.929 809.875 0.00100541 0.00122428 2024-09-16T03:42:09.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.179+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:42:09.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:09.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.207+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:42:09.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.211+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:09.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.215+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:42:09.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.219+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:09.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.235+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:42:09.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.235+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:09.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:09.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.271+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:09.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.291+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:42:09.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.311+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:09.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.311+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:09.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:42:09.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:42:09.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.347+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:42:09.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.355+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:42:09.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.367+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:09.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.379+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:09.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.391+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:42:09.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:09.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.411+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:42:09.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:42:09.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.427+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:42:09.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:42:09.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.463+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:42:09.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.471+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:42:09.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.471+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:09.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.495+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:42:09.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.511+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:42:09.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.515+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:09.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.531+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:09.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.539+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:42:09.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.543+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:42:09.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.551+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:09.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.559+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:09.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.563+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:42:09.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.571+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:42:09.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.587+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:42:09.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.591+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:09.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.615+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:09.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.627+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:09.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:09.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.635+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:42:09.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.647+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:42:09.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.647+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:09.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.663+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:42:09.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.667+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:42:09.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.671+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:09.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:09.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.711+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:42:09.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.735+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:42:09.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:42:09.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.751+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:42:09.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.759+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:09.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:42:09.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.787+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:09.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.791+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:42:09.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.811+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:42:09.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.843+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:09.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.843+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:42:09.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.863+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:42:09.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.867+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:42:09.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:09.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:09.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.891+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:42:09.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:42:09.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.899+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:42:09.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.907+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:42:09.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.927+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:42:09.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.971+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:42:09.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:09.991+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:42:10.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.007+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:42:10.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.023+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:42:10.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.023+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:42:10.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.039+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:42:10.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.043+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:42:10.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.063+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:10.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:42:10.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.083+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:10.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:10.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.091+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:42:10.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.111+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:10.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.119+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:42:10.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.127+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:10.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:42:10.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 24 16 310286 310270 807.922 784.812 0.00109346 0.00122582 2024-09-16T03:42:10.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.155+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:42:10.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.159+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:10.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.171+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:10.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.175+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:10.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.175+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:42:10.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.187+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:42:10.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.207+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:10.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.223+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:42:10.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.223+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:42:10.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.231+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:42:10.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.243+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:42:10.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.251+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:42:10.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.251+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:10.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.267+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:10.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.283+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:42:10.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.287+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:42:10.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:10.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.303+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:42:10.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.307+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:42:10.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.311+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:42:10.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:42:10.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.335+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:42:10.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.339+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:42:10.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.343+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:42:10.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.355+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:42:10.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.367+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:10.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.383+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:42:10.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:42:10.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.407+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:10.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:42:10.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.427+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:10.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.439+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:10.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.439+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:10.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:42:10.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:10.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.475+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:10.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.503+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:42:10.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.507+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:42:10.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.519+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:42:10.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.527+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:42:10.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.527+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:10.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.535+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:42:10.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.535+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:42:10.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.543+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:42:10.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:42:10.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:42:10.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.595+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:10.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.599+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:42:10.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.607+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:10.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.635+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:42:10.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.651+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:10.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.651+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:42:10.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.667+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:42:10.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.687+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:10.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.691+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:10.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.703+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:42:10.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.711+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:42:10.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.719+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:42:10.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.723+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:42:10.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.755+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:42:10.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.767+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:42:10.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.779+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:42:10.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:42:10.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.783+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:42:10.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.823+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:42:10.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.843+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:42:10.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.859+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:10.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.863+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:42:10.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.883+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:42:10.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.903+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:42:10.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.911+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:42:10.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:42:10.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.931+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:42:10.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.935+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:42:10.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:10.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.959+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:42:10.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.963+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:42:10.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.979+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:42:10.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.991+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:11.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:10.999+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:11.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.003+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:11.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.007+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:42:11.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.019+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:42:11.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.027+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:11.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.035+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:11.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:42:11.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.059+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:11.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:11.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.067+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:42:11.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.103+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:11.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.107+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:42:11.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.131+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:42:11.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:11.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.135+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:42:11.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.147+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:11.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.147+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:42:11.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 25 16 322905 322889 807.15 788.688 0.000702039 0.00122682 2024-09-16T03:42:11.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.183+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:42:11.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.195+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:11.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.203+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:42:11.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.211+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:42:11.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.223+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:11.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:42:11.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.247+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:11.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.263+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:11.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:42:11.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.275+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:42:11.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.283+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:42:11.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.283+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:11.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.307+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:11.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.311+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:42:11.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.323+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:42:11.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.331+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:11.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.347+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:11.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.347+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:11.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.379+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:42:11.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.387+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:11.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:42:11.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.415+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:42:11.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.427+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:42:11.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.435+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:42:11.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:11.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.463+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:42:11.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.475+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:11.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.507+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:11.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.511+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:11.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.523+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:42:11.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:11.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.539+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:42:11.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.559+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:42:11.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.571+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:11.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.571+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:42:11.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.575+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:11.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.599+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:42:11.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:42:11.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.603+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:42:11.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:42:11.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.627+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:42:11.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.651+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:11.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.651+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:42:11.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.675+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:42:11.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.679+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:42:11.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.683+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:42:11.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.707+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:42:11.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.711+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:42:11.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.711+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:11.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.719+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:42:11.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.735+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:42:11.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.743+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:42:11.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.767+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:42:11.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.771+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:11.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.779+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:42:11.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:11.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.795+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:42:11.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.803+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:42:11.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.811+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:42:11.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.835+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:42:11.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.859+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:11.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:42:11.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.863+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:42:11.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.871+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:11.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.895+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:42:11.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.899+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:11.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.903+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:42:11.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:42:11.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.927+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:42:11.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.947+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:42:11.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.955+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:11.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.955+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:42:11.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.959+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:42:11.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.963+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:11.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.979+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:42:12.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:11.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:12.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.011+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:42:12.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.019+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:42:12.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.035+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:42:12.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.055+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:12.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.059+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:12.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.075+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:42:12.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.083+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:42:12.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.091+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:42:12.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.095+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:42:12.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.123+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:42:12.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:12.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.155+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:42:12.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 26 16 335937 335921 807.43 814.5 0.000993939 0.00122662 2024-09-16T03:42:12.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.171+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:42:12.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.175+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:42:12.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.179+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:42:12.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.187+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:12.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:42:12.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.199+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:42:12.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.215+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:12.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.215+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:42:12.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:42:12.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.279+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:42:12.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.291+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:12.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:42:12.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.335+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:12.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:42:12.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.343+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:42:12.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.363+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:42:12.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.375+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:42:12.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.403+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:12.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:42:12.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.415+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:42:12.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.431+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:12.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.431+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:12.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:42:12.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.459+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:12.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.463+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:12.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.483+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:42:12.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.487+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:42:12.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.487+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:42:12.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.495+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:42:12.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.511+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:42:12.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.515+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:42:12.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.527+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:42:12.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.535+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:42:12.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.535+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:42:12.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:12.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.563+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:42:12.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.575+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:12.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.583+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:12.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.595+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:12.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:42:12.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.603+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:42:12.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:42:12.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.639+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:42:12.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.655+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:12.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.675+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:42:12.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.683+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:42:12.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.699+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:12.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.699+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:12.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.707+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:42:12.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.735+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:42:12.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:42:12.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:12.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.767+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:12.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.775+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:12.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.807+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:42:12.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.807+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:42:12.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.819+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:42:12.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.847+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:12.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.851+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:42:12.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.851+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:42:12.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.859+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:42:12.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.859+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:42:12.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:42:12.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.887+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:42:12.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.923+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:42:12.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.923+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:42:12.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.927+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:12.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.939+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:12.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.955+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:42:12.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.975+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:42:12.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.975+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:42:12.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:42:12.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.983+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:42:13.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:12.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:42:13.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.023+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:42:13.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.055+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:13.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.059+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:42:13.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.075+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:42:13.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:42:13.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.095+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:42:13.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:42:13.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.103+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:42:13.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.119+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:13.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.139+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:13.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.147+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:42:13.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 27 16 348830 348814 807.368 805.812 0.00252719 0.00122659 2024-09-16T03:42:13.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:42:13.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.159+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:13.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.167+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:42:13.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:42:13.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.191+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:13.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.199+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:42:13.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:13.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.211+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:13.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.243+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:13.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.247+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:42:13.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.251+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:42:13.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.251+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:42:13.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.263+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:42:13.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.275+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:42:13.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.295+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:13.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:42:13.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.327+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:42:13.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.335+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:13.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.339+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:42:13.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.355+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:42:13.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.359+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:13.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:42:13.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:13.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.395+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:42:13.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:13.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.427+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:42:13.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.431+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:42:13.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.443+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:42:13.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:13.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.475+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:42:13.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.479+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:42:13.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.479+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:13.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.503+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:42:13.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:13.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.519+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:42:13.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.527+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:13.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.527+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:42:13.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.559+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:42:13.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.575+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:13.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.575+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:13.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.583+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:42:13.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.591+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:42:13.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.591+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:42:13.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.603+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:13.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.643+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:13.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.659+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:42:13.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.659+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:42:13.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.667+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:42:13.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.671+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:42:13.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:42:13.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.707+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:42:13.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.715+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:13.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.735+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:42:13.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.739+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:42:13.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:42:13.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.763+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:13.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.763+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:13.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.775+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:42:13.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:13.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.795+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:13.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.807+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:13.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.811+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:42:13.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.819+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:13.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.835+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:13.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:42:13.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.859+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:42:13.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.859+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:42:13.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.883+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:13.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.891+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:42:13.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.895+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:42:13.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.915+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:42:13.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.919+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:42:13.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.923+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:13.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.927+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:13.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.943+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:13.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.955+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:42:13.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.971+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:42:13.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.979+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:14.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:13.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:14.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.003+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:42:14.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.019+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:14.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.027+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:42:14.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.031+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:42:14.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.039+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:14.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.047+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:42:14.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.071+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:42:14.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.075+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:14.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:42:14.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:42:14.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.099+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:42:14.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.103+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:14.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.127+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:42:14.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.139+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:42:14.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.143+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:14.156 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 28 16 361650 361634 807.147 801.25 0.000826848 0.00122701 2024-09-16T03:42:14.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.159+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:42:14.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.159+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:14.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.183+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:42:14.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.195+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:14.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.195+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:14.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:14.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.223+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:14.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.235+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:42:14.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.267+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:14.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.271+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:42:14.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.279+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:14.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.287+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:42:14.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.295+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:42:14.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:42:14.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.307+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:42:14.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.335+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:42:14.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.343+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:14.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.355+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:42:14.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.355+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:42:14.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:14.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.375+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:42:14.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.387+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:14.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.399+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:42:14.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.411+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:42:14.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.415+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:14.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:14.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.439+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:14.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:42:14.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.471+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:42:14.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.491+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:42:14.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:14.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.515+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:14.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:14.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.563+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:14.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:42:14.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.587+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:42:14.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.607+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:42:14.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.635+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:42:14.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.635+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:42:14.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.663+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:42:14.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:14.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.675+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:42:14.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.687+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:14.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.691+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:42:14.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.723+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:14.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.731+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:42:14.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.735+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:42:14.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.743+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:42:14.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.755+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:42:14.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.755+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:42:14.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.759+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:14.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.767+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:42:14.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.787+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:42:14.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:42:14.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.811+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:42:14.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.835+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:42:14.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.851+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:14.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.855+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:42:14.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:14.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:14.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.883+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:42:14.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.883+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:42:14.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.907+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:42:15.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:14.999+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:42:15.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.011+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:42:15.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.027+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:42:15.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.039+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:42:15.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.059+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:15.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.067+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:42:15.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.067+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:42:15.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.099+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:42:15.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.103+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:42:15.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.103+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:42:15.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.127+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:15.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:42:15.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.139+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:42:15.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.151+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:15.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 29 16 373498 373482 804.847 740.5 0.000835578 0.00123052 2024-09-16T03:42:15.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:42:15.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:15.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.207+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:15.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.219+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:42:15.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.227+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:42:15.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.227+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:15.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:15.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.255+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:42:15.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.259+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:15.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.263+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:15.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.267+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:42:15.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.291+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:42:15.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.295+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:15.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.295+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:42:15.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.311+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:42:15.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:42:15.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:42:15.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.335+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:42:15.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.355+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:42:15.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.359+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:42:15.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:42:15.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.371+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:15.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.375+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:42:15.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.399+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:42:15.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.431+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:42:15.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.435+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:42:15.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.443+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:42:15.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:42:15.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.471+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:42:15.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.479+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:42:15.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.491+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:42:15.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.515+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:15.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.519+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:42:15.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.519+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:15.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.535+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:42:15.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.559+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:42:15.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:15.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.571+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:42:15.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:15.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.571+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:42:15.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.587+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:15.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.599+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:42:15.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.599+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:42:15.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.603+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:42:15.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.631+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:15.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.635+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:42:15.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.639+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:42:15.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.655+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:42:15.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.659+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:42:15.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.663+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:15.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:15.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:42:15.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.683+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:42:15.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.683+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:15.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.707+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:42:15.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.723+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:15.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:42:15.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.731+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:42:15.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.755+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:42:15.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.779+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:15.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.811+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:42:15.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.811+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:42:15.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:15.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.831+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:42:15.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:15.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.871+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:42:15.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.883+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:15.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.883+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:15.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.887+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:15.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:15.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.911+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:42:15.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.923+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:42:15.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.935+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:42:15.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.943+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:42:15.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.967+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:42:15.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.983+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:15.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.995+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:42:15.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.999+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:42:16.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:15.999+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:16.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.003+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:16.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:42:16.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:42:16.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.067+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:42:16.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.071+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:16.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.071+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:16.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.087+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:42:16.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.107+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:42:16.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.111+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:16.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.127+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:42:16.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.131+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:16.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.151+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:42:16.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.151+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:16.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 30 16 386380 386364 804.854 805.125 0.000890544 0.00123055 2024-09-16T03:42:16.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:42:16.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:42:16.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.171+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:16.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.187+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:42:16.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.207+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:42:16.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.219+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:16.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.219+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:42:16.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.227+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:42:16.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.227+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:16.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.255+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:42:16.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.259+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:42:16.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:42:16.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.271+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:42:16.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:42:16.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.319+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:42:16.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.323+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:42:16.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.347+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:42:16.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.351+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:16.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.359+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:16.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.379+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:42:16.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.379+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:42:16.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.411+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:42:16.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.423+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:16.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.427+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:42:16.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.431+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:42:16.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.459+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:16.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.463+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:42:16.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:16.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:42:16.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:42:16.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.491+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:42:16.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.495+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:16.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.527+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:42:16.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.535+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:16.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.539+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:42:16.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.543+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:42:16.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.555+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:42:16.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.567+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:16.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.579+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:16.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.603+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:16.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.611+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:42:16.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:42:16.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.627+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:42:16.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.635+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:42:16.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.635+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:42:16.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.651+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:42:16.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.651+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:42:16.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:42:16.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.679+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:42:16.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.691+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:42:16.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.715+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:42:16.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.715+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:42:16.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.719+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:42:16.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.731+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:42:16.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.743+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:42:16.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:42:16.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:42:16.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.759+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:42:16.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.767+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:16.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.787+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:42:16.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.803+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:42:16.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.807+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:42:16.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.811+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:42:16.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:42:16.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.839+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:42:16.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.863+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:42:16.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.867+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:16.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.887+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:42:16.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.907+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:42:16.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:42:16.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.915+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:42:16.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.923+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:42:16.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:42:16.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.955+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:42:16.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.963+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:42:16.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.967+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:42:16.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.971+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:42:16.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:16.995+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:17.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.019+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:42:17.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.023+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:42:17.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.023+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:17.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.031+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:17.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.043+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:42:17.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.063+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:42:17.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.067+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:42:17.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.075+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:17.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.083+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:42:17.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.087+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:42:17.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.107+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:42:17.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.111+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:42:17.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.115+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:42:17.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.143+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:42:17.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 31 16 399139 399123 804.612 797.438 0.000972405 0.00123092 2024-09-16T03:42:17.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.159+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:42:17.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.163+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:17.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.171+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:42:17.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.183+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:42:17.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.207+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:42:17.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:17.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.227+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:17.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.235+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:17.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.235+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:42:17.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.275+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:17.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:42:17.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:42:17.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.287+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:42:17.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.291+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:42:17.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.311+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:42:17.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.315+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:42:17.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.327+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:42:17.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.327+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:42:17.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.347+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:42:17.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.351+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:17.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.359+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:17.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.375+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:17.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.387+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:42:17.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.391+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:17.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.395+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:42:17.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.407+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:17.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.423+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:17.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.423+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:42:17.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.471+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:42:17.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.475+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:42:17.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.475+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:42:17.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:17.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.523+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:42:17.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.531+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:42:17.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.543+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:42:17.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.555+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:42:17.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.555+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:17.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.559+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:42:17.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.595+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:42:17.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.599+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:17.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.619+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:42:17.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.655+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:42:17.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.655+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:42:17.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.683+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:42:17.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.691+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:42:17.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.695+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:17.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:42:17.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.719+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:17.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.719+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:42:17.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.727+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:42:17.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.727+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:42:17.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:17.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.759+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:17.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.775+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:17.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.779+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:42:17.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.791+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:42:17.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.811+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:42:17.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:42:17.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.819+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:17.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.823+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:17.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.855+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:42:17.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.879+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:17.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.899+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:42:17.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.907+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:42:17.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.919+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:42:17.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.927+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:42:17.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.931+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:42:17.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.947+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:42:17.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.951+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:42:17.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.955+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:17.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.963+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:42:17.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.963+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:18.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:17.995+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:18.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.007+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:18.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.019+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:18.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.031+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:42:18.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.051+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:18.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.063+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:42:18.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.079+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:42:18.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.099+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:42:18.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.103+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:42:18.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.103+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:42:18.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.107+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:18.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.123+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:18.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:42:18.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.139+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:42:18.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 32 16 412292 412276 805.155 822.062 0.000778485 0.00123007 2024-09-16T03:42:18.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.155+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:42:18.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.159+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:42:18.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.163+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:18.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.191+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:42:18.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.199+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:18.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:42:18.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.223+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:18.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.235+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:42:18.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.235+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:42:18.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.239+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:42:18.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.243+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:42:18.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.259+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:42:18.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.263+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:42:18.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.279+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:42:18.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.303+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:18.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.311+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:18.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.323+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:42:18.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.331+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:18.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:42:18.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:18.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.347+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:18.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:18.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.379+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:42:18.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.391+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:18.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.423+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:42:18.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.427+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:18.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.431+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:18.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.447+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:42:18.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:18.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.479+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:18.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.479+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:42:18.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.483+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:18.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.487+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:42:18.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.515+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:18.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.527+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:42:18.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.535+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:42:18.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.539+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:18.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.543+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:42:18.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.551+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:18.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.571+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:18.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.579+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:42:18.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.583+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:42:18.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.583+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:18.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:18.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:42:18.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.651+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:18.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.663+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:42:18.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.663+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:42:18.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.679+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:42:18.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.711+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:42:18.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.715+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:42:18.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.719+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:42:18.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.727+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:42:18.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.727+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:42:18.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.735+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:42:18.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.755+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:42:18.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:42:18.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.775+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:18.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.787+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:18.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.795+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:42:18.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.803+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:42:18.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.803+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:42:18.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:42:18.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.827+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:42:18.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:42:18.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.843+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:42:18.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.855+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:42:18.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.875+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:18.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.895+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:42:18.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.895+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:42:18.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.911+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:42:18.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.927+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:42:18.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.947+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:18.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.955+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:42:18.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.959+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:18.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.983+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:42:18.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.987+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:18.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:18.995+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:19.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.011+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:42:19.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.019+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:19.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.031+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:42:19.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.039+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:42:19.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.043+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:19.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.043+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:19.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.063+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:42:19.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.083+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:42:19.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.091+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:42:19.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.091+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:42:19.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.095+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:19.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.107+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:19.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.119+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:19.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.127+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:19.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.135+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:42:19.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.143+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:19.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.147+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:19.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.155+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:19.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 33 16 425244 425228 805.284 809.5 0.000607577 0.00122987 2024-09-16T03:42:19.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.171+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:42:19.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:42:19.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.183+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:42:19.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:42:19.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:19.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.231+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:42:19.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:19.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.255+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:42:19.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.263+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:42:19.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:19.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:42:19.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.295+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:42:19.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.323+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:42:19.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.331+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:42:19.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.351+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:19.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.351+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:42:19.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.355+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:19.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.375+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:42:19.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.391+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:42:19.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.403+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:42:19.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:42:19.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.419+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:42:19.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.431+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:42:19.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.443+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:19.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:42:19.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:19.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.467+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:42:19.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:42:19.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.495+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:42:19.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.495+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:42:19.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.499+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:42:19.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.511+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:19.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.519+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:42:19.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.531+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:42:19.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.531+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:42:19.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:42:19.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.571+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:42:19.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:42:19.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.575+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:42:19.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.591+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:42:19.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.615+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:19.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.619+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:19.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.623+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:19.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.639+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:19.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.655+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:42:19.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.659+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:42:19.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.667+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:42:19.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.679+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:42:19.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.699+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:42:19.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.703+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:42:19.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:19.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.723+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:19.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.731+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:42:19.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.751+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:19.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.759+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:42:19.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.763+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:42:19.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.775+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:42:19.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.775+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:42:19.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:42:19.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.791+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:19.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.807+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:19.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.815+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:42:19.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.831+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:42:19.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.835+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:42:19.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.847+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:42:19.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.855+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:42:19.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.859+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:19.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.863+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:19.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.891+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:42:19.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.895+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:19.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.895+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:42:19.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.951+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:42:19.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:19.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.951+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:19.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.955+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:19.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:19.963+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:20.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:20.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.071+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:42:20.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.075+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:20.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.079+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:20.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.079+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:42:20.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.111+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:42:20.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:42:20.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.127+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:42:20.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.135+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:20.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.139+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:20.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.143+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:42:20.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 34 15 437048 437033 803.298 737.812 0.000842687 0.00123291 2024-09-16T03:42:20.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.155+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:42:20.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.155+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:20.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.191+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:20.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.195+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:20.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.199+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:42:20.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.211+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:20.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.219+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:42:20.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.223+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:20.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.231+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:20.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.247+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:42:20.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.251+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:42:20.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.259+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:20.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.259+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:20.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.295+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:42:20.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.299+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:42:20.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.323+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:42:20.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.327+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:42:20.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:42:20.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.363+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:42:20.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.383+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:42:20.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.387+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:42:20.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.403+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:20.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.415+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:20.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:42:20.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.431+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:20.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.443+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:20.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.455+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:42:20.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.459+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:42:20.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.463+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:42:20.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:20.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.479+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:20.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.487+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:42:20.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.495+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:42:20.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.507+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:20.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:42:20.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.531+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:42:20.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.535+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:42:20.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.539+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:42:20.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:42:20.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:20.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.619+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:42:20.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.623+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:20.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.627+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:42:20.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.643+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:20.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.643+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:42:20.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.655+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:20.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.667+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:42:20.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.675+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:42:20.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.683+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:42:20.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.699+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:42:20.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.723+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:20.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:42:20.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.743+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:42:20.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.767+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:20.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.771+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:42:20.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:42:20.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.815+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:42:20.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.827+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:42:20.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.855+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:20.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:20.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:42:20.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.871+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:42:20.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:20.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.899+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:20.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.899+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:42:20.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.931+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:42:20.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.943+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:42:20.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:42:20.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.967+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:20.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.991+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:20.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:42:20.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:20.995+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:42:21.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.007+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:42:21.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.019+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:42:21.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:42:21.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.059+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:42:21.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.063+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:42:21.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.071+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:42:21.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.091+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:42:21.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.111+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:42:21.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.127+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:42:21.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.131+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:42:21.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.143+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:42:21.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.151+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:42:21.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 35 15 450409 450394 804.204 835.062 0.00264633 0.0012316 2024-09-16T03:42:21.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.163+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:42:21.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.179+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:42:21.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:42:21.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.199+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:21.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.203+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:21.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.235+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:42:21.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:42:21.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.275+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:42:21.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.283+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:21.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.299+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:42:21.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.307+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:42:21.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:42:21.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.319+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:42:21.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.327+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:42:21.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.375+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:42:21.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:42:21.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.395+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:21.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.403+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:21.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.411+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:42:21.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:42:21.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:21.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.431+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:42:21.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.439+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:21.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:42:21.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.447+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:42:21.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.471+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:42:21.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.483+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:42:21.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.499+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:21.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.507+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:21.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.515+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:21.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.539+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:42:21.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:21.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.551+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:21.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.563+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:21.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.567+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:21.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.571+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:42:21.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.575+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:42:21.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:42:21.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.611+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:42:21.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.627+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:42:21.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:42:21.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.647+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:42:21.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.655+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:21.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.659+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:42:21.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.667+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:42:21.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.691+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:42:21.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.703+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:21.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.739+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:21.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:21.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.747+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:42:21.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.763+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:42:21.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.767+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:42:21.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.775+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:42:21.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.823+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:42:21.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.827+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:42:21.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.839+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:21.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.839+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:42:21.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.851+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:21.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.867+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:42:21.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.871+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:42:21.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.875+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:21.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.875+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:42:21.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.887+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:42:21.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.891+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:21.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.931+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:42:21.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:42:21.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.951+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:42:21.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.951+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:42:21.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.959+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:42:21.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.971+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:42:21.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.983+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:42:21.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:21.987+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:42:22.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.003+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:22.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.011+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:42:22.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.039+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:42:22.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.043+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:42:22.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.051+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:42:22.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.055+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:42:22.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.087+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:42:22.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.087+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:42:22.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.091+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:22.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.111+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:22.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.119+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:42:22.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:22.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.135+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:22.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.139+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:42:22.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.151+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:42:22.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 36 15 463710 463695 804.955 831.312 0.00115418 0.00123042 2024-09-16T03:42:22.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.171+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:42:22.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.179+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:42:22.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:22.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.199+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:42:22.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.203+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:22.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.207+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:42:22.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.231+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:42:22.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.243+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:42:22.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.247+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:22.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.255+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:42:22.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.263+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:22.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.275+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:42:22.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.275+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:42:22.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:42:22.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:42:22.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.303+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:22.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.343+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:22.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.343+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:42:22.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.347+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:42:22.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.359+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:42:22.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.371+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:42:22.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.375+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:42:22.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.403+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:42:22.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.407+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:22.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:22.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.451+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:42:22.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.451+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:42:22.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:42:22.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.471+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:42:22.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:22.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.499+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:42:22.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.503+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:22.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.511+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:22.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.539+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:42:22.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.551+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:42:22.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.559+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:22.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.563+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:22.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.575+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:42:22.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.579+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:42:22.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.595+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:42:22.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.599+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:42:22.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.607+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:22.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.639+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:42:22.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.639+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:22.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.643+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:42:22.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.647+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:22.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.667+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:42:22.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.675+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:42:22.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.687+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:42:22.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.695+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:42:22.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:22.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.719+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:42:22.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.723+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:42:22.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.727+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:22.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.743+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:42:22.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.747+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:42:22.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.779+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:42:22.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.787+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:42:22.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:42:22.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.803+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:42:22.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.819+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:42:22.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:42:22.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.839+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:42:22.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.839+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:22.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.863+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:42:22.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.863+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:22.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.867+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:42:22.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.871+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:42:22.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:22.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.903+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:42:22.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:42:22.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.915+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:42:22.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.919+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:22.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:42:22.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.943+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:22.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.943+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:42:22.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:22.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.959+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:42:22.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.967+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:42:22.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.987+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:22.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:22.991+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:42:23.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.007+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:42:23.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.007+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:42:23.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.019+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:42:23.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.039+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:42:23.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.055+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:42:23.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.055+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:42:23.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.063+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:23.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.071+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:23.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.079+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:42:23.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.095+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:42:23.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.103+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:42:23.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.111+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:42:23.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:42:23.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.143+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:42:23.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.155+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:42:23.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.155+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:42:23.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 37 16 476356 476340 804.557 790.312 0.000759169 0.00123103 2024-09-16T03:42:23.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.175+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:23.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:42:23.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.183+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:42:23.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.187+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:42:23.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.207+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:42:23.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:42:23.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.239+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:42:23.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.243+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:42:23.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.251+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:23.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.251+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:42:23.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.283+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:42:23.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.283+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:23.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.287+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:42:23.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.295+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:42:23.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.299+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:23.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:42:23.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.315+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:23.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.339+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:42:23.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.347+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:42:23.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.351+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:23.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.395+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:23.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.403+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:23.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.411+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:42:23.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.415+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:23.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.419+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:42:23.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.455+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:42:23.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.479+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:23.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:23.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:42:23.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.507+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:23.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.511+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:23.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.527+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:23.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.563+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:42:23.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.579+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:23.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.587+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:42:23.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.603+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:23.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.611+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:23.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:23.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.639+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:23.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.663+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:42:23.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.663+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:42:23.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:42:23.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.699+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:42:23.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.699+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:23.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:42:23.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.715+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:42:23.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.731+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:42:23.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.731+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:23.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.735+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:42:23.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.763+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:42:23.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.763+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:23.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:23.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.803+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:23.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:42:23.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.811+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:42:23.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.831+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:42:23.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:42:23.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.851+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:23.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.855+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:23.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.863+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:42:23.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.875+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:42:23.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:23.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.891+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:23.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.899+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:42:23.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.907+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:23.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.919+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:23.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.923+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:42:23.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.935+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:23.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.935+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:42:23.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.947+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:42:23.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.959+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:42:23.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.967+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:42:23.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:23.995+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:24.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.007+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:42:24.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.011+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:24.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.075+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:24.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.087+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:42:24.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.095+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:42:24.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.131+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:42:24.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.135+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:24.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.135+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:24.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.147+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:42:24.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.147+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:42:24.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 38 16 489509 489493 805.016 822.062 0.000725785 0.00123027 2024-09-16T03:42:24.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.155+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:42:24.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.163+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:42:24.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.179+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:42:24.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.191+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:24.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.211+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:42:24.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.211+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:24.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.219+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:24.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.231+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:42:24.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.231+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:42:24.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.259+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:42:24.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.275+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:42:24.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:24.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.283+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:42:24.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.295+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:42:24.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.303+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:42:24.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.319+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:42:24.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.339+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:24.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.343+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:42:24.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.343+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:42:24.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.363+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:42:24.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.367+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:42:24.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.379+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:42:24.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:24.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.535+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:42:24.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:24.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:42:24.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.603+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:42:24.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.615+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:42:24.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.619+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:42:24.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.627+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:42:24.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.647+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:24.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.651+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:42:24.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.659+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:24.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.691+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:42:24.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.691+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:42:24.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.703+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:42:24.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.703+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:24.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.731+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:42:24.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.743+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:24.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.747+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:42:24.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.763+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:42:24.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.771+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:24.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:42:24.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.791+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:42:24.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:24.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:24.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.835+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:42:24.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.835+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:24.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.847+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:42:24.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.855+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:24.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.867+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:42:24.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.891+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:24.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.903+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:24.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.927+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:42:24.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:42:24.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.947+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:24.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:24.979+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:42:25.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.003+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:42:25.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.015+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:25.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.023+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:42:25.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.027+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:25.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.031+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:25.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.051+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:42:25.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.059+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:25.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.087+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:25.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.103+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:42:25.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:42:25.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.131+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:25.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:42:25.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.151+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:25.157 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 39 15 501030 501015 802.838 720.125 0.000901292 0.00123363 2024-09-16T03:42:25.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:25.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.219+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:42:25.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:42:25.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.227+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:42:25.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.243+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:42:25.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.247+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:25.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.259+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:42:25.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.283+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:42:25.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.287+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:42:25.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:42:25.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.315+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:25.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.319+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:42:25.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:42:25.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.339+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:25.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.343+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:25.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:42:25.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.379+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:42:25.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.383+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:42:25.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:25.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.391+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:42:25.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.415+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:42:25.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:25.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.439+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:42:25.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:25.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.487+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:42:25.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.511+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:42:25.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.519+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:25.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.535+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:42:25.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.551+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:25.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.559+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:25.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.571+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:42:25.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.575+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:42:25.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.579+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:42:25.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:42:25.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.587+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:25.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.603+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:25.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.631+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:25.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:42:25.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:42:25.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.639+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:25.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.651+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:42:25.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.655+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:42:25.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.659+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:42:25.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.687+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:25.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.699+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:42:25.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.711+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:42:25.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:25.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.735+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:25.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.739+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:42:25.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.755+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:25.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:42:25.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:25.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.791+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:25.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.799+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:42:25.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.823+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:42:25.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.831+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:25.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.835+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:25.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:42:25.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.847+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:25.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:42:25.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.867+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:42:25.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:25.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.883+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:42:25.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.911+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:42:25.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.915+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:42:25.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.915+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:25.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.939+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:42:25.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.959+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:25.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:25.975+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:42:26.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.019+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:42:26.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.035+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:26.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:26.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.071+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:42:26.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.075+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:42:26.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.075+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:42:26.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:26.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.091+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:26.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.095+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:42:26.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.123+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:42:26.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.143+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:42:26.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.143+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:26.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.155+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:26.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:42:26.158026+0000 min lat: 0.000239237 max lat: 0.103823 avg lat: 0.0012325 2024-09-16T03:42:26.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:42:26.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 40 16 514344 514328 803.564 832.062 0.000783308 0.0012325 2024-09-16T03:42:26.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.171+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:26.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.183+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:26.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.183+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:26.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.187+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:42:26.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:26.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.211+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:42:26.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.235+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:42:26.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.251+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:26.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.263+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:26.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.267+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:42:26.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:42:26.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.307+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:26.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.311+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:26.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.335+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:26.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.339+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:42:26.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.339+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:26.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.351+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:42:26.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.359+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:42:26.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.375+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:42:26.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.395+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:42:26.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.399+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:42:26.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.411+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:42:26.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:42:26.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.419+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:42:26.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.427+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:42:26.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.435+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:42:26.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.459+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:42:26.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.467+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:26.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.475+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:42:26.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.479+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:42:26.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.491+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:42:26.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.503+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:26.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:42:26.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.515+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:42:26.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.547+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:42:26.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.563+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:42:26.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.563+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:42:26.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.567+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:42:26.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.615+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:42:26.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.615+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:42:26.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.635+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:26.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.655+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:26.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.663+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:42:26.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:26.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:26.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.679+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:42:26.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.695+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:42:26.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.695+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:26.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.707+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:42:26.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.727+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:42:26.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.727+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:42:26.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.755+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:42:26.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.779+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:42:26.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.795+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:26.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.795+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:42:26.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.799+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:26.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.803+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:42:26.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.807+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:26.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.819+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:26.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.827+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:42:26.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.843+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:42:26.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.863+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:42:26.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.863+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:26.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.867+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:26.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:42:26.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:42:26.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.903+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:26.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.923+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:42:26.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.927+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:26.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.927+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:26.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.947+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:42:26.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.955+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:42:26.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:26.975+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:42:27.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.003+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:42:27.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.011+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:42:27.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.039+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:27.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:27.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.051+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:27.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.055+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:42:27.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.067+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:27.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.071+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:27.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.099+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:42:27.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.099+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:42:27.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.119+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:27.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.131+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:42:27.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 41 16 527252 527236 803.637 806.75 0.000761273 0.00123243 2024-09-16T03:42:27.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.159+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:42:27.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.163+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:27.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.163+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:42:27.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.191+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:27.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.215+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:27.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:42:27.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.251+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:27.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.255+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:42:27.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.255+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:27.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.267+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:27.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.267+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:42:27.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.291+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:42:27.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.291+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:27.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.319+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:42:27.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:42:27.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.351+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:27.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.371+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:27.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.379+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:42:27.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.391+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:42:27.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.395+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:27.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.415+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:27.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.435+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:27.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.443+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:27.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.443+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:42:27.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:42:27.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.463+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:42:27.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.491+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:42:27.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.495+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:42:27.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:42:27.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.523+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:27.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.547+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:42:27.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.547+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:42:27.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.547+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:27.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.567+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:42:27.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.575+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:42:27.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:42:27.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.619+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:42:27.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.643+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:27.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.651+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:27.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.651+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:42:27.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.655+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:42:27.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.663+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:42:27.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.699+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:42:27.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.723+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:42:27.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:27.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.771+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:27.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.799+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:42:27.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.799+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:42:27.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.799+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:27.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.807+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:42:27.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.811+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:42:27.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.847+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:27.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.863+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:27.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:27.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.867+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:27.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:27.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.887+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:42:27.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.899+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:27.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.927+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:27.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.927+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:42:27.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.939+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:27.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.947+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:42:27.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.955+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:42:27.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.955+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:42:27.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.975+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:42:27.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:27.991+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:42:28.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.003+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:42:28.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.007+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:42:28.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.019+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:42:28.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.027+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:42:28.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.071+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:42:28.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.083+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:28.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:42:28.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.107+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:42:28.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.107+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:28.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.107+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:42:28.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.127+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:42:28.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:42:28.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:42:28.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 42 16 540376 540360 804.031 820.25 0.000804561 0.00123175 2024-09-16T03:42:28.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.159+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:42:28.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.171+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:42:28.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.199+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:28.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.203+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:42:28.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.207+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:28.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.215+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:42:28.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.239+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:28.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.247+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:42:28.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.255+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:28.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.259+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:28.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.275+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:28.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.291+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:42:28.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.295+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:42:28.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.295+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:28.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.307+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:42:28.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.319+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:28.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.319+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:28.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:28.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:42:28.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:42:28.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.375+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:28.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.399+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:42:28.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.411+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:42:28.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:42:28.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.431+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:42:28.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.443+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:42:28.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.447+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:28.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.451+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:42:28.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.459+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:28.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.499+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:28.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.503+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:42:28.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.507+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:28.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:28.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.539+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:42:28.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.543+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:42:28.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.547+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:42:28.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.563+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:28.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.571+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:28.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.587+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:42:28.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.603+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:28.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.619+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:42:28.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.635+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:28.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.643+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:42:28.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.643+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:42:28.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.655+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:42:28.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.683+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:42:28.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.687+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:42:28.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.687+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:42:28.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.707+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:42:28.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.707+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:42:28.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.715+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:28.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.735+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:42:28.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.751+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:42:28.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.779+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:42:28.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.783+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:28.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.787+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:28.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.807+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:42:28.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.815+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:28.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:28.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.827+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:42:28.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.827+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:42:28.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.835+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:42:28.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.847+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:42:28.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.859+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:28.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.871+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:42:28.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.907+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:42:28.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.911+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:42:28.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.919+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:42:28.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.947+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:42:28.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:28.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.967+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:42:28.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.987+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:42:29.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:28.999+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:42:29.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.003+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:42:29.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.011+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:42:29.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.015+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:42:29.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.031+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:42:29.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.035+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:42:29.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.059+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:42:29.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.059+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:42:29.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.075+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:42:29.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.075+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:29.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.099+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:42:29.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.107+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:29.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.111+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:29.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.147+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:42:29.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.147+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:29.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.151+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:42:29.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 43 16 553524 553508 804.442 821.75 0.00112353 0.00123116 2024-09-16T03:42:29.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:42:29.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.183+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:29.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.183+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:42:29.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.187+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:29.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:42:29.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.215+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:42:29.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.219+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:29.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.239+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:42:29.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.255+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:29.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.275+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:42:29.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.279+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:29.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.291+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:42:29.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.299+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:42:29.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.303+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:29.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.307+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:29.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.311+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:42:29.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:29.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.347+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:42:29.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.363+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:29.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.395+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:42:29.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:42:29.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.403+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:42:29.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:42:29.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.439+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:42:29.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.451+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:29.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.471+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:29.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.475+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:42:29.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.487+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:29.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:42:29.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.491+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:29.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.579+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:29.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.579+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:42:29.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:29.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.587+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:42:29.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.635+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:42:29.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.643+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:42:29.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.663+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:42:29.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.667+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:42:29.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.687+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:42:29.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.703+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:29.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.727+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:29.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.731+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:29.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:42:29.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.763+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:42:29.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.783+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:42:29.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.799+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:42:29.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.823+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:42:29.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.831+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:29.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:42:29.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.863+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:42:29.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.867+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:29.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.887+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:42:29.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:42:29.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.899+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:42:29.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.903+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:29.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.927+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:42:29.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.931+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:42:29.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:42:29.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.943+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:42:29.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.963+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:42:29.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:29.967+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:30.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.087+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:30.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.115+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:42:30.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.131+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:30.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.135+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:30.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:42:30.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.155+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:30.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 44 16 564014 563998 801.058 655.625 0.00176612 0.00123634 2024-09-16T03:42:30.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.163+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:42:30.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.179+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:42:30.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.183+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:42:30.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:42:30.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.207+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:42:30.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.211+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:42:30.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.219+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:30.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.219+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:42:30.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.267+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:42:30.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.275+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:42:30.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.279+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:42:30.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:42:30.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.307+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:42:30.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.323+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:42:30.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.331+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:30.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.343+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:42:30.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:30.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.363+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:30.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.375+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:42:30.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.375+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:30.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.407+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:42:30.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.407+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:42:30.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:42:30.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:30.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.431+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:30.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.451+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:42:30.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.455+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:42:30.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.455+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:42:30.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.463+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:42:30.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.471+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:30.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.499+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:42:30.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.503+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:42:30.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.507+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:30.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.531+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:42:30.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.535+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:42:30.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.539+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:42:30.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.547+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:30.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.555+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:42:30.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.571+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:42:30.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.575+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:42:30.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.575+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:42:30.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.587+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:42:30.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.607+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:42:30.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.627+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:30.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.631+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:42:30.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:42:30.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.643+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:42:30.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.655+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:30.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.663+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:42:30.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.675+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:42:30.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.695+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:30.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.723+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:42:30.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.743+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:42:30.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.751+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:30.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.755+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:42:30.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.759+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:42:30.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.759+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:42:30.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.763+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:30.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.803+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:42:30.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.807+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:42:30.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.811+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:42:30.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:42:30.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.831+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:30.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.831+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:42:30.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.843+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:42:30.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:30.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.879+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:30.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.891+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:30.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.891+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:42:30.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.907+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:42:30.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.911+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:30.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.947+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:30.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.947+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:30.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.951+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:42:30.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.951+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:30.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:30.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:31.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.007+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:42:31.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.011+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:31.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.015+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:42:31.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.027+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:31.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.027+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:42:31.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.031+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:42:31.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:31.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.047+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:42:31.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.075+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:42:31.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.075+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:42:31.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.087+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:31.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.099+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:42:31.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.099+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:42:31.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.115+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:31.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.127+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:42:31.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.131+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:42:31.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 45 16 576712 576696 800.891 793.625 0.00141477 0.00123669 2024-09-16T03:42:31.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.159+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:42:31.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.171+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:42:31.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.179+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:42:31.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.183+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:42:31.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.195+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:42:31.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.203+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:42:31.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.207+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:42:31.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.207+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:31.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.211+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:42:31.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.223+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:42:31.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.227+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:42:31.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.255+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:42:31.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.255+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:42:31.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:42:31.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.267+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:31.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.275+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:31.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.295+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:42:31.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:42:31.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.335+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:42:31.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:42:31.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.355+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:31.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.371+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:42:31.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.391+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:31.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.391+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:42:31.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:42:31.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.419+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:42:31.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.431+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:42:31.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.431+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:31.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.447+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:42:31.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.463+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:42:31.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.471+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:42:31.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.475+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:42:31.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.479+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:31.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.483+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:42:31.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.499+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:42:31.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.519+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:42:31.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.527+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:42:31.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.531+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:31.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.559+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:31.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:31.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.563+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:42:31.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.567+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:42:31.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.591+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:42:31.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.603+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:42:31.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.603+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:42:31.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:42:31.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.651+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:42:31.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.655+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:42:31.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:42:31.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.679+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:31.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.687+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:42:31.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.691+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:31.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.695+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:31.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.723+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:42:31.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.735+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:42:31.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:42:31.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.743+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:42:31.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.763+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:31.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.767+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:31.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.775+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:31.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.807+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:42:31.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.819+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:42:31.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.819+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:31.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.823+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:31.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.827+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:42:31.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.835+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:42:31.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.847+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:31.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.859+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:31.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.883+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:42:31.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:42:31.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.935+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:42:31.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.935+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:31.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.939+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:31.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.943+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:42:31.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.959+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:42:31.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.987+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:42:31.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.991+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:42:31.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:31.995+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:42:32.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.007+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:42:32.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.019+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:32.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.043+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:42:32.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.051+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:32.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.055+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:32.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.059+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:42:32.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.091+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:32.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.103+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:42:32.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.115+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:42:32.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:42:32.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.143+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:32.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.143+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:42:32.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 46 16 589839 589823 801.315 820.438 0.000841696 0.00123599 2024-09-16T03:42:32.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:42:32.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.163+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:42:32.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:32.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.175+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:42:32.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.219+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:42:32.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.227+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:32.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.231+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:42:32.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.235+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:32.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.243+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:42:32.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.259+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:42:32.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.267+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:32.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.271+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:42:32.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:32.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.315+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:42:32.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.319+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:32.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.327+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:32.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.327+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:42:32.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.331+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:32.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.331+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:32.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.375+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:32.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.375+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:42:32.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.379+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:42:32.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:42:32.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.411+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:42:32.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.439+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:42:32.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.447+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:42:32.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.455+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:42:32.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.467+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:42:32.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.503+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:32.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:32.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.507+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:42:32.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:42:32.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.519+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:42:32.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.523+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:42:32.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.523+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:42:32.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:32.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.575+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:42:32.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:42:32.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.595+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:42:32.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.607+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:32.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.635+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:42:32.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.643+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:42:32.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.659+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:32.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.663+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:42:32.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:42:32.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.699+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:32.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.703+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:42:32.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.715+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:32.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.719+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:42:32.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.747+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:32.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.747+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:42:32.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.751+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:42:32.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:42:32.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.759+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:32.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.775+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:32.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.803+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:42:32.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.811+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:42:32.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.827+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:42:32.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.827+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:32.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.835+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:42:32.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.855+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:32.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.875+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:42:32.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.883+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:32.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.887+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:32.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.891+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:32.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.903+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:42:32.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.927+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:42:32.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.943+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:42:32.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.943+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:42:32.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.951+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:42:32.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.963+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:42:32.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.971+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:32.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:32.975+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:33.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.003+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:42:33.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.011+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:42:33.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.027+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:33.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.031+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:42:33.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.035+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:33.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:42:33.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.051+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:33.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:42:33.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.071+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:33.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:42:33.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.111+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:42:33.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.123+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:42:33.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.123+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:42:33.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.127+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:42:33.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.155+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:42:33.158 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 47 16 602536 602520 801.148 793.562 0.000793644 0.0012363 2024-09-16T03:42:33.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.155+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:42:33.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.159+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:42:33.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.163+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:42:33.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.163+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:33.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.199+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:33.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.203+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:33.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.215+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:33.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.215+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:42:33.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:42:33.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.251+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:33.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.251+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:42:33.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.263+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:42:33.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.275+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:33.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.279+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:42:33.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.287+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:42:33.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.291+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:42:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.303+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.307+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:42:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.331+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.331+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.339+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.343+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.367+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.407+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.427+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.435+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.463+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.479+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:42:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.483+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.487+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.503+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.511+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.519+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.519+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.531+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.539+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.539+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.571+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.571+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.575+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:42:33.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.587+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.603+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.651+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.655+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.663+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.679+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.683+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.707+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.711+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:33.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.719+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.735+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.743+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.759+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.759+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.763+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:42:33.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.783+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:42:33.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.811+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:42:33.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.835+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:42:33.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.851+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:33.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:33.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.879+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:42:33.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.891+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:42:33.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.895+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:42:33.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.911+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:42:33.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.915+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:42:33.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.915+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:42:33.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.943+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:33.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.943+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:42:33.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:42:33.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.979+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:42:33.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.983+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:42:33.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:33.991+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:42:34.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.003+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:42:34.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.007+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:34.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.031+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:34.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.047+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:34.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.047+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:34.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.051+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:42:34.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.075+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:42:34.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.075+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:34.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:42:34.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.095+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:34.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.107+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:34.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.115+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:42:34.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.127+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:42:34.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.139+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:42:34.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 48 16 615383 615367 801.184 802.938 0.0008831 0.00123625 2024-09-16T03:42:34.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.163+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:34.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.163+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:42:34.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.175+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:42:34.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:42:34.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.199+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:42:34.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.203+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:42:34.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.203+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:42:34.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.207+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:42:34.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.227+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:42:34.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.231+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:34.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.247+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:34.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.283+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:42:34.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:34.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.303+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:42:34.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.323+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:42:34.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.327+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:42:34.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.331+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:42:34.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.343+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:42:34.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.355+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:42:34.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.367+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:42:34.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.367+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:42:34.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.391+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:34.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.395+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:42:34.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:42:34.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.435+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:34.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.435+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:42:34.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.439+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:42:34.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.451+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:34.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.459+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:42:34.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.483+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:42:34.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.483+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:42:34.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.483+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:34.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.499+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:34.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:42:34.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.519+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:34.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.535+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:34.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.543+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:42:34.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.547+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:42:34.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.555+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:42:34.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:34.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.595+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:42:34.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:42:34.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.603+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:34.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.619+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:42:34.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.643+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:42:34.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.655+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:34.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.667+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:42:34.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:42:34.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.679+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:42:34.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.691+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:34.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.691+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:34.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.699+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:42:34.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.707+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:34.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.715+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:42:34.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.731+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:42:34.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.739+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:34.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.743+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:42:34.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:42:34.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.783+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:42:34.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.783+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:34.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:34.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.803+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:42:34.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.815+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:34.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.823+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:42:34.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.827+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:42:34.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.855+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:34.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.867+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:42:34.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.887+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:34.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.891+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:34.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.899+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:42:34.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.919+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:42:34.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.919+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:34.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.931+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:34.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.931+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:34.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.967+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:42:34.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.971+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:34.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.975+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:34.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.991+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:42:35.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:34.999+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:42:35.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.039+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:42:35.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.039+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:42:35.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.051+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:42:35.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.059+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:35.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.079+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:35.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.079+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:42:35.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.099+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:42:35.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.107+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:35.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:42:35.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.139+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:42:35.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 49 16 628253 628237 801.248 804.375 0.00298694 0.00123616 2024-09-16T03:42:35.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.159+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:42:35.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.159+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:35.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.171+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:42:35.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.183+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:35.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:42:35.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:42:35.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:42:35.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.235+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:42:35.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.259+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:35.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.263+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:35.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.267+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:35.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.291+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:42:35.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.291+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:42:35.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.291+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:35.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.307+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:42:35.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.323+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:35.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:42:35.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.335+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:35.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.355+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:35.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:35.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.363+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:42:35.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.395+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:42:35.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.395+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:35.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.407+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:35.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:42:35.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:35.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.443+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:42:35.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.447+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:35.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.459+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:35.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.471+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:42:35.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.479+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:42:35.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.503+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:42:35.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:35.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.527+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:42:35.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.539+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:42:35.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.539+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:42:35.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.547+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:42:35.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.563+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:42:35.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.567+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:42:35.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:42:35.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.587+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:35.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.591+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:35.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.603+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:35.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.615+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:42:35.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.615+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:42:35.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.643+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:42:35.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.647+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:42:35.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.675+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:42:35.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.687+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:42:35.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.703+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:42:35.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.711+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:42:35.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.723+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:42:35.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.723+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:42:35.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.755+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:42:35.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.783+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:42:35.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.783+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:35.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.795+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:35.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.799+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:42:35.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.799+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:42:35.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.823+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:35.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:35.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.847+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:35.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.851+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:42:35.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.859+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:42:35.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:42:35.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:42:35.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.883+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:35.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.887+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:42:35.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.919+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:35.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.923+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:42:35.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:42:35.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.955+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:35.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.971+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:35.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:35.975+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:42:36.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:36.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.031+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:42:36.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.035+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:42:36.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.047+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:42:36.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.079+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:36.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.087+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:42:36.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.091+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:36.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:42:36.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.107+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:42:36.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.111+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:36.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.135+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:42:36.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.147+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:42:36.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.151+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:42:36.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:42:36.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 50 16 641463 641447 801.734 825.625 0.000628868 0.00123536 2024-09-16T03:42:36.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.159+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:42:36.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.163+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:36.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.175+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:36.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.187+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:36.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.195+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:42:36.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.199+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:42:36.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.215+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:36.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.223+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:42:36.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.247+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:42:36.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.251+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:42:36.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.291+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:42:36.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.291+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:36.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.299+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:36.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.299+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:36.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.327+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:42:36.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.339+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:36.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.339+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:42:36.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:36.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.403+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:36.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.411+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:42:36.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.411+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:42:36.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.427+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:42:36.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.431+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:42:36.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.439+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:42:36.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.451+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:42:36.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.475+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:36.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.483+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:36.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.499+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:42:36.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.499+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:42:36.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:36.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.547+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:36.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.559+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:42:36.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.571+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:42:36.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.579+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:42:36.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.587+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:42:36.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.591+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:42:36.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.595+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:42:36.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.615+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:42:36.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.615+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:36.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.635+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:36.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.639+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:42:36.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:36.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.655+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:36.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.671+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:42:36.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.695+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:36.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.703+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:42:36.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.711+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:42:36.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.711+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:42:36.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.731+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:36.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:42:36.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.735+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:36.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.771+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:42:36.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.779+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:36.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.783+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:36.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.791+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:36.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.795+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:42:36.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.807+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:36.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.807+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:42:36.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.811+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:36.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.823+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:42:36.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.843+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:42:36.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.851+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:42:36.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:36.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.883+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:42:36.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.891+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:36.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.899+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:42:36.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.903+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:42:36.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.907+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:42:36.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.919+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:42:36.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.923+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:42:36.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:42:36.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.967+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:42:37.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:36.999+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:42:37.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.007+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:42:37.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.031+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:42:37.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:42:37.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:37.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:37.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.099+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:42:37.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.107+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:42:37.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.115+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:42:37.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.123+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:42:37.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.139+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:42:37.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.155+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:42:37.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 51 15 654256 654241 801.691 799.625 0.00093227 0.00123548 2024-09-16T03:42:37.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.163+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:42:37.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.167+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:42:37.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.171+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:42:37.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.191+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:42:37.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.199+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:37.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.207+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:42:37.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.211+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:42:37.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.223+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:37.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.227+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:37.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.247+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:42:37.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.279+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:42:37.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.283+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:37.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:42:37.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.303+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:37.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.323+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:37.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.327+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:37.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.335+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:42:37.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.339+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:37.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.347+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:37.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.359+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:37.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:37.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.379+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:37.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.395+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:37.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.411+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:42:37.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.419+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:42:37.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.443+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:42:37.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.455+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:37.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.483+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:37.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.487+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:42:37.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.503+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:42:37.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.515+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:37.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.523+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:42:37.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.523+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:42:37.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.527+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:42:37.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.551+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:42:37.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.559+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:37.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:37.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.587+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:37.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.591+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:37.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.611+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:42:37.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.611+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:42:37.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.611+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:42:37.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:42:37.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.627+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:37.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:42:37.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.667+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:37.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:42:37.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.687+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:42:37.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.699+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:42:37.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.715+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:42:37.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.719+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:42:37.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.727+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:42:37.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.727+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:42:37.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:42:37.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.775+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:42:37.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.779+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:42:37.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.787+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:42:37.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.807+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:37.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.807+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:37.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.811+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:42:37.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.827+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:42:37.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.831+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:37.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.831+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:42:37.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.867+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:42:37.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.871+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:37.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.891+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:42:37.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.895+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:37.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.899+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:37.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.911+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:42:37.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.919+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:42:37.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.939+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:42:37.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.943+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:42:37.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.963+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:37.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.971+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:37.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:37.983+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:42:38.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.019+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:42:38.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.023+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:38.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.031+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:42:38.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.051+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:42:38.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.055+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:42:38.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:38.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.083+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:38.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:38.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.095+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:42:38.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.115+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:42:38.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.119+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:38.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.123+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:38.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:38.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.139+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:42:38.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 52 16 667228 667212 801.863 810.688 0.000610543 0.00123514 2024-09-16T03:42:38.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.163+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:42:38.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:42:38.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.231+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:42:38.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.247+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:42:38.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.251+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:38.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.255+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:38.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.259+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:42:38.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.275+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:42:38.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.283+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:42:38.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.287+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:42:38.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.303+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:42:38.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.323+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:38.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:38.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.343+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:42:38.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.351+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:38.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.371+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:38.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.379+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:42:38.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.383+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:42:38.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.383+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:42:38.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:42:38.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.451+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:42:38.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.459+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:38.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:42:38.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.475+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:42:38.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.483+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:42:38.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.495+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:42:38.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.495+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:38.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.507+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:42:38.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.511+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:38.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:38.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.555+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:42:38.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.567+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:38.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.575+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:42:38.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.583+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:38.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.587+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:42:38.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:38.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:42:38.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:42:38.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.623+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:42:38.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.647+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:42:38.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.655+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:42:38.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.663+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:38.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.663+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:42:38.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.675+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:38.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.711+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:42:38.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.715+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:42:38.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.731+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:38.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:42:38.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.759+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:42:38.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.775+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:38.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.779+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:38.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.787+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:42:38.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.811+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:42:38.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.815+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:38.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.843+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:38.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.855+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:42:38.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.871+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:42:38.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.871+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:42:38.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.875+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:42:38.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.875+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:42:38.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.911+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:42:38.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:42:38.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.935+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:38.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.963+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:42:38.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.963+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:42:38.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.967+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:42:38.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:38.987+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:39.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.023+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:42:39.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.035+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:42:39.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:39.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.055+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:39.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.055+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:42:39.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.063+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:42:39.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.091+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:42:39.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:42:39.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.107+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:39.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.135+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:42:39.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:42:39.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 53 16 680481 680465 802.36 828.312 0.000722921 0.00123443 2024-09-16T03:42:39.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:42:39.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:39.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:39.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:42:39.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.199+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:42:39.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.203+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:42:39.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:39.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.239+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:42:39.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.251+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:42:39.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.267+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:42:39.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.275+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:42:39.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.283+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:39.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.291+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:39.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.299+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:39.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.311+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:42:39.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:39.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.347+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:42:39.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.351+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:42:39.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.359+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:39.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:42:39.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.375+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:39.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.379+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:42:39.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.419+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:42:39.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.427+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:42:39.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.431+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:42:39.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.443+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:42:39.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.451+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:42:39.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:42:39.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.471+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:42:39.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.475+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:39.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:39.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.527+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:39.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.531+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:42:39.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.535+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:42:39.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.539+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:42:39.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.543+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:42:39.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.555+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:42:39.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.670+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:42:39.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.702+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:42:39.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.738+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:42:39.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:42:39.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:42:39.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.774+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:39.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.782+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:42:39.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.810+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:42:39.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.814+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:42:39.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.838+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:42:39.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.850+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:42:39.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.874+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:42:39.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.890+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:42:39.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:39.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.894+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:42:39.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.918+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:42:39.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.922+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:42:39.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.930+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:39.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.930+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:42:39.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.958+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:42:39.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.974+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:42:39.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.986+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:39.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:42:40.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:39.998+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:40.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.014+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:42:40.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.030+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:42:40.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.034+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:42:40.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.046+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:42:40.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.070+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:42:40.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.074+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:42:40.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.078+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:40.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.094+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:42:40.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.098+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:42:40.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.102+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:42:40.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.138+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:40.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.138+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:42:40.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.142+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:40.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.150+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:42:40.159 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 54 15 691929 691914 800.752 715.562 0.00108579 0.00123683 2024-09-16T03:42:40.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.162+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:40.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.178+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:42:40.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.178+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:40.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.198+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:42:40.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.226+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:40.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:42:40.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.234+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:42:40.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.246+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:42:40.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.274+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:42:40.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.282+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:42:40.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.290+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:42:40.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.306+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:42:40.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.314+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:42:40.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.318+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:42:40.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.326+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:42:40.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.334+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:40.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:40.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:42:40.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.358+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:42:40.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.390+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:42:40.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.402+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:42:40.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.402+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:40.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.402+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:40.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.422+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:42:40.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.438+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:40.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.438+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:42:40.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.450+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:40.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.470+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:42:40.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.482+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:42:40.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.486+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:42:40.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.494+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:42:40.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.494+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:40.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.514+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:42:40.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.522+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:40.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.550+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:42:40.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:42:40.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.574+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:42:40.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.590+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:40.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.610+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:42:40.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.614+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:42:40.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.626+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:40.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:42:40.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.634+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:40.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.646+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:40.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.650+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:40.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.650+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:42:40.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.678+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:42:40.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.694+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:40.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.698+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:40.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.710+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:42:40.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.710+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:42:40.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.726+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:42:40.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.726+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:40.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.730+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:40.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.746+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:40.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.774+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:40.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:40.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.786+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:40.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.794+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:42:40.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.810+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:42:40.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.834+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:40.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.850+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:40.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.866+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:40.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.870+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:40.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.882+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:42:40.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.898+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:40.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.918+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:40.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.938+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:42:40.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.942+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:42:40.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.946+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:40.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:42:40.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.966+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:40.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.990+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:42:41.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:40.998+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:42:41.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.002+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:41.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.014+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:42:41.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:42:41.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.058+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:42:41.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.058+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:42:41.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:42:41.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.078+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:42:41.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.082+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:41.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.098+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:42:41.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.102+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:41.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.118+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:42:41.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.122+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:41.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.138+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:42:41.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.146+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:42:41.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 55 16 705022 705006 801.066 818.25 0.00130282 0.0012364 2024-09-16T03:42:41.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:42:41.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.170+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:42:41.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.182+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:41.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.194+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:41.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.214+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:42:41.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.222+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:42:41.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.234+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:42:41.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.254+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:42:41.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.258+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:42:41.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.262+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:42:41.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.262+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:42:41.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.290+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:41.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.298+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:42:41.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.306+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:41.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.314+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:42:41.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.338+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:42:41.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.342+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:42:41.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.342+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:42:41.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.354+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:41.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.358+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:42:41.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.362+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:42:41.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.382+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:41.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.394+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:42:41.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.402+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:42:41.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.422+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:41.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.422+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:42:41.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.434+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:42:41.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.454+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:42:41.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.470+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:42:41.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.478+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:42:41.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.478+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:42:41.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:42:41.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.514+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:42:41.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.518+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:42:41.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.522+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:42:41.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:42:41.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.546+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:42:41.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.558+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:42:41.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.562+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:42:41.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.578+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:42:41.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.586+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:42:41.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.602+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:42:41.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.610+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:41.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.614+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:42:41.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.618+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:41.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.646+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:41.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.662+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:41.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.662+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:41.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.686+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:42:41.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.686+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:42:41.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.698+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:42:41.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.734+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:42:41.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:42:41.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:42:41.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:41.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.814+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:42:41.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.822+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:42:41.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.842+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:42:41.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.846+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:42:41.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:42:41.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.862+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:42:41.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.878+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:42:41.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.882+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:41.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.914+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:42:41.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.938+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:42:41.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:42:41.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.938+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:41.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:42:41.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.990+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:42:41.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.990+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:41.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:41.994+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:42:42.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.018+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:42:42.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.030+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:42.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.046+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:42.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.054+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:42.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:42:42.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.082+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:42.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.086+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:42:42.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.122+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:42.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.122+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:42.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.134+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:42:42.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.134+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:42:42.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 56 16 718340 718324 801.624 832.375 0.00081832 0.00123552 2024-09-16T03:42:42.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.162+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:42:42.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.182+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:42.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.186+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:42.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.190+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:42.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.194+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:42:42.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.206+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:42:42.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.206+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:42:42.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.234+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:42:42.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.250+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:42:42.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.258+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:42:42.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.274+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:42.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.274+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:42:42.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.278+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:42:42.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.278+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:42.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.282+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:42:42.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.298+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:42:42.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.326+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:42:42.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:42.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.350+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:42.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.354+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:42.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.358+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:42:42.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.374+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:42:42.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.398+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:42:42.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.402+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:42:42.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.402+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:42.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:42.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.410+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:42:42.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.414+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:42:42.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:42:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.446+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:42:42.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.478+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:42.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.490+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:42:42.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.490+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:42:42.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:42:42.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.514+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:42:42.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.530+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:42.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:42.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.546+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:42:42.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.550+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:42:42.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.558+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:42:42.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.570+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:42:42.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.590+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:42:42.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.594+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:42.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.614+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:42.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.618+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:42:42.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.630+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:42.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:42:42.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.654+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:42.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.658+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:42:42.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.658+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:42:42.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.670+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:42:42.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.682+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:42:42.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.682+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:42:42.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.710+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:42:42.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.722+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:42:42.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.726+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:42:42.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.750+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:42.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:42:42.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.778+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:42.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.782+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:42:42.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.786+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:42.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.810+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:42:42.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.814+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:42:42.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.814+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:42.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.858+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:42.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:42:42.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.874+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:42.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.882+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:42:42.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.910+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:42:42.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.926+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:42:42.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.938+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:42:42.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.942+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:42:42.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:42.950+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:42:43.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.002+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:42:43.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:43.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.038+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:42:43.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.042+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:43.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.054+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:43.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.062+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:42:43.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.082+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:43.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.082+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:42:43.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.090+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:42:43.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.090+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:43.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.098+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:43.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:43.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.142+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:43.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.150+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:42:43.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.150+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:43.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.154+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:42:43.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 57 16 731342 731326 801.816 812.625 0.00104723 0.00123524 2024-09-16T03:42:43.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.170+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:42:43.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.174+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:43.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.178+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:42:43.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.186+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:42:43.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.194+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:43.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:42:43.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.218+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:42:43.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:42:43.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.238+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:42:43.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.250+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:42:43.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.266+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:42:43.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:42:43.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.294+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:42:43.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.302+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:42:43.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.306+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:42:43.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.334+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:42:43.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.334+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:43.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.338+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:43.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.358+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:42:43.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.390+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:42:43.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:42:43.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.434+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:42:43.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.442+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:42:43.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.446+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:43.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:43.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.478+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:43.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.486+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:43.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.506+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:43.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.506+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:42:43.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.506+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:42:43.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.510+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:43.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.526+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:42:43.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.534+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:43.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:42:43.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.558+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:43.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.578+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:43.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.590+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:42:43.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.602+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:43.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.610+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:42:43.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.630+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:43.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.634+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:42:43.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.658+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:42:43.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.666+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:42:43.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.690+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:42:43.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.694+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:42:43.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.698+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:42:43.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.710+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:43.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.710+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:43.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.730+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:43.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.738+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:42:43.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.742+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:43.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.758+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:43.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.778+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:43.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.794+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:42:43.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.794+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:43.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:43.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:43.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.818+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:42:43.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.822+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:42:43.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.846+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:42:43.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.862+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:42:43.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.866+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:42:43.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.866+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:43.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:42:43.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.902+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:43.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.902+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:42:43.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.910+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:43.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.914+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:42:43.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.942+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:42:43.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:43.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.962+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:43.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.974+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:43.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.982+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:42:43.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.990+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:42:44.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:43.998+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:42:44.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.030+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:44.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.034+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:44.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.042+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:44.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.042+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:42:44.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.070+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:44.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.070+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:42:44.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:42:44.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:44.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.114+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:42:44.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.126+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:42:44.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.142+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:42:44.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.150+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:42:44.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 58 15 744325 744310 801.981 811.5 0.000863357 0.00123499 2024-09-16T03:42:44.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.158+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:42:44.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.182+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:44.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:44.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.194+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:42:44.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:42:44.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:44.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.222+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:44.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.226+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:42:44.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.250+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:42:44.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.254+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:42:44.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.258+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:42:44.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.266+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:44.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.290+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:42:44.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.302+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:42:44.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.318+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:42:44.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.322+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:42:44.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.334+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:44.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.338+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:44.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.338+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:42:44.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.358+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:42:44.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.362+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:42:44.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.362+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:44.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.402+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:42:44.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.410+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:42:44.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.422+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:42:44.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.426+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:42:44.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.430+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:42:44.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.442+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:42:44.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.458+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:42:44.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.466+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:42:44.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.470+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:44.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.486+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:42:44.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.502+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:42:44.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.506+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:42:44.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.510+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:44.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.530+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:42:44.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.534+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:42:44.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.534+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:42:44.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.542+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:42:44.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.554+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:42:44.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.570+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:44.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:42:44.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.634+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:42:44.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.666+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:42:44.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.678+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:42:44.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.694+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:42:44.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.714+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:42:44.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.730+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:44.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.742+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:42:44.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:42:44.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.758+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:42:44.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.766+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:44.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.786+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:44.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:42:44.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.814+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:42:44.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.826+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:42:44.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:44.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.850+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:44.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.862+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:44.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.870+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:42:44.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.878+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:44.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.886+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:42:44.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:42:44.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.898+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:42:44.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.910+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:42:44.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.914+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:42:44.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.922+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:42:44.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:44.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.942+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:44.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.966+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:42:44.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.970+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:44.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.986+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:45.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:44.998+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:45.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.010+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:42:45.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.014+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:42:45.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.018+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:42:45.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.034+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:42:45.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.038+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:42:45.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.062+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:42:45.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.062+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:42:45.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.074+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:42:45.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.098+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:42:45.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.102+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:42:45.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:42:45.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.118+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:42:45.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.126+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:42:45.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.138+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:45.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.138+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:45.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.154+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:45.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 59 16 756683 756667 801.477 772.312 0.000575436 0.00123571 2024-09-16T03:42:45.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.166+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:42:45.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.182+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:42:45.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:42:45.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.190+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:42:45.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.206+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:42:45.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.210+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:45.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.218+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:42:45.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.218+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:42:45.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.242+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:42:45.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.246+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:42:45.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.250+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:42:45.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.286+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:42:45.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.302+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:42:45.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.302+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:42:45.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.314+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:45.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.322+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:42:45.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:45.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.350+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:42:45.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.354+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:42:45.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.370+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:42:45.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:42:45.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.394+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:42:45.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.398+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:42:45.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.414+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:42:45.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.418+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:42:45.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.426+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:42:45.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.442+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:45.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.442+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:45.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:42:45.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.454+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:42:45.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.454+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:42:45.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.478+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:42:45.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.494+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:42:45.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.498+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:45.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:42:45.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.530+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:42:45.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.530+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:42:45.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.546+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:42:45.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.554+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:42:45.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.554+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:42:45.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.562+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:45.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.578+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:42:45.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:42:45.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.590+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:42:45.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.606+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:45.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:42:45.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.622+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:42:45.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.634+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:42:45.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.658+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:42:45.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.674+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:42:45.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.682+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:42:45.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.694+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:42:45.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.698+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:42:45.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.710+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:42:45.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.714+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:42:45.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.718+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:45.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.730+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:42:45.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.734+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:45.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.738+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:42:45.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.754+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:42:45.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.774+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:42:45.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.786+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:42:45.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.826+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:42:45.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.830+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:45.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.842+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:42:45.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.858+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:45.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.862+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:42:45.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.866+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:42:45.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.882+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:45.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.890+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:45.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.894+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:42:45.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.918+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:42:45.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.918+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:45.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.922+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:42:45.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.942+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:42:45.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.950+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:45.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.958+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:42:45.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.978+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:42:45.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.982+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:42:45.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:45.990+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:42:46.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.006+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:46.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.014+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:42:46.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.046+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:42:46.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.062+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:42:46.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.062+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:42:46.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.062+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:42:46.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.074+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:42:46.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.074+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:42:46.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.114+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:46.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:42:46.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.138+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:46.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.142+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:46.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:42:46.160100+0000 min lat: 0.000239237 max lat: 0.129137 avg lat: 0.00123654 2024-09-16T03:42:46.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:42:46.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 60 16 769035 769019 800.985 772 0.00104833 0.00123654 2024-09-16T03:42:46.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.158+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:46.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.162+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:46.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.174+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:42:46.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.186+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:42:46.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:42:46.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.206+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:42:46.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.214+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:42:46.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.222+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:42:46.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.230+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:42:46.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.230+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:42:46.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.274+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:42:46.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.274+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:42:46.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.274+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:46.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.290+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:42:46.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.294+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:42:46.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.294+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:42:46.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.302+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:42:46.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:42:46.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:42:46.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.362+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:46.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.362+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:42:46.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.370+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:42:46.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.386+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:42:46.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.394+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:42:46.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.410+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:42:46.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.434+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:42:46.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.450+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:42:46.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.454+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:42:46.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.458+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:42:46.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.478+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:46.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.482+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:42:46.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.502+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:42:46.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.518+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:42:46.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.546+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:42:46.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.554+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:46.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.562+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:42:46.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.582+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:42:46.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.582+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:42:46.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.594+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:42:46.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.634+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:42:46.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.638+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:42:46.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.642+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:42:46.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.682+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:42:46.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:46.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.698+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:46.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.714+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:42:46.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.714+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:42:46.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.726+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:42:46.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.726+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:42:46.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.742+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:42:46.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.746+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:42:46.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.758+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:46.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.762+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:42:46.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.766+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:42:46.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.770+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:42:46.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.794+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:42:46.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.802+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:46.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.810+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:42:46.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.818+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:46.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.826+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:46.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.826+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:46.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.846+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:42:46.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.862+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:42:46.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.866+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:46.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.882+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:42:46.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.886+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:42:46.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.918+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:42:46.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.930+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:42:46.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.930+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:42:46.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.942+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:46.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.942+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:42:46.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.958+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:42:46.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.958+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:42:46.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.966+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:46.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.990+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:42:47.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:46.998+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:42:47.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.018+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:42:47.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.030+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:42:47.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.034+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:42:47.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.046+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:42:47.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.054+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:42:47.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.062+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:42:47.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.098+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:42:47.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.110+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:42:47.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.114+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:47.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.118+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:47.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.130+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:42:47.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.150+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:42:47.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.150+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:42:47.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 61 16 781739 781723 800.869 794 0.00113153 0.00123673 2024-09-16T03:42:47.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.162+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:42:47.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.178+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:42:47.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.190+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:42:47.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.194+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:42:47.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.198+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:42:47.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.206+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:42:47.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.210+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:47.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.230+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:42:47.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.250+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:42:47.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.266+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:42:47.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.274+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:42:47.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.278+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:42:47.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.290+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:47.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.310+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:42:47.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.322+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:42:47.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.334+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:42:47.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.354+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:42:47.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.378+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:42:47.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.378+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:47.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.398+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:42:47.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:47.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.406+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:42:47.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:42:47.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:42:47.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.430+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:47.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.442+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:42:47.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.466+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:47.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.486+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:42:47.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.486+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:42:47.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.498+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:42:47.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.498+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:42:47.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.510+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:42:47.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.522+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:42:47.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:47.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:42:47.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.542+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:42:47.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.546+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:42:47.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.550+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:42:47.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.582+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:42:47.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.582+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:47.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:47.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.610+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:42:47.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.622+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:42:47.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:42:47.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.634+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:42:47.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.646+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:42:47.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.666+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:47.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.674+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:42:47.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.698+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:42:47.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.710+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:42:47.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.714+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:42:47.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.718+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:42:47.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.726+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:42:47.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.746+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:42:47.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.750+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:42:47.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.766+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:42:47.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.774+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:47.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.802+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:42:47.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:42:47.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.814+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:42:47.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.814+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:47.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.830+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:42:47.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.842+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:42:47.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.850+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:42:47.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.854+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:47.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.862+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:42:47.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.866+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:42:47.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.882+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:42:47.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.886+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:42:47.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.906+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:47.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.914+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:47.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.918+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:42:47.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.934+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:42:47.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.950+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:47.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.954+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:42:47.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.958+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:42:47.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.978+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:42:47.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:42:48.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:47.998+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:42:48.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.046+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:48.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.054+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:48.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.058+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:42:48.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.062+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:42:48.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.070+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:42:48.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.090+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:42:48.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.090+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:48.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.094+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:42:48.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.098+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:42:48.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.142+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:42:48.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.150+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:48.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 62 15 794581 794566 800.898 802.688 0.00103719 0.00123669 2024-09-16T03:42:48.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.162+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:42:48.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.166+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:42:48.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.190+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:42:48.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.206+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:48.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.218+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:48.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.222+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:42:48.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.238+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:42:48.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.242+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:42:48.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.250+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:42:48.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.266+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:42:48.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.270+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:42:48.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:42:48.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.310+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:42:48.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.326+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:42:48.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.330+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:48.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.334+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:42:48.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.342+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:42:48.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.366+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:48.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.366+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:48.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.374+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:42:48.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:42:48.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.414+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:42:48.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.414+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:48.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.442+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:42:48.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.446+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:48.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.458+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:42:48.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.470+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:42:48.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.490+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:42:48.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.490+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:42:48.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.494+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:42:48.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.518+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:42:48.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:42:48.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.538+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:48.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.550+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:48.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.554+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:42:48.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.558+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:42:48.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.582+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:42:48.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.586+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:42:48.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.594+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:42:48.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.606+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:42:48.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.638+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:42:48.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.650+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:42:48.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.670+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:42:48.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.674+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:42:48.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.682+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:42:48.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.706+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:42:48.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:48.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.726+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:48.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.726+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:48.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.738+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:48.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.750+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:48.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:42:48.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.770+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:42:48.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.778+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:42:48.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.786+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:48.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.786+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:42:48.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.802+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:42:48.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.810+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:42:48.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.818+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:42:48.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.818+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:42:48.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.842+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:42:48.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.870+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:48.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.874+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:48.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:48.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:42:48.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.886+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:42:48.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.910+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:48.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.914+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:48.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.918+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:42:48.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:42:48.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.954+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:42:48.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:42:48.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.978+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:42:48.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.982+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:48.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.986+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:48.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:48.986+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:42:49.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.006+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:42:49.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.018+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:42:49.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.018+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:42:49.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.030+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:42:49.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.034+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:49.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.050+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:42:49.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.054+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:42:49.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.094+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:49.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.110+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:42:49.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.110+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:42:49.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.122+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:42:49.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.122+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:49.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.146+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:42:49.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.154+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:42:49.160 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 63 15 807441 807426 800.941 803.75 0.00112862 0.00123662 2024-09-16T03:42:49.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.162+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:42:49.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.182+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:42:49.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.186+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:49.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:49.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.206+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:42:49.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:42:49.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.226+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:42:49.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.246+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:42:49.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.246+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:42:49.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.278+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:42:49.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.286+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:49.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:42:49.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.314+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:42:49.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.318+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:42:49.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.338+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:49.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.354+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:49.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.358+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:42:49.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.366+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:49.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.366+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:49.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.390+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:49.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.402+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:42:49.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.414+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:49.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.414+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:42:49.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.438+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:42:49.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.438+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:42:49.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.442+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:49.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.446+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:49.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:42:49.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.494+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:42:49.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:42:49.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.526+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:42:49.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.546+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:42:49.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.554+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:42:49.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.606+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:42:49.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.614+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:42:49.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.634+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:42:49.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.634+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:49.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.654+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:42:49.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.658+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:49.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.686+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:42:49.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.690+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:42:49.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.694+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:49.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:42:49.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.710+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:42:49.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.730+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:42:49.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.734+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:42:49.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.762+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:42:49.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.766+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:42:49.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.782+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:49.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:42:49.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.790+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:42:49.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.798+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:42:49.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.798+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:49.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:42:49.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.818+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:42:49.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.826+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:49.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:42:49.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.854+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:42:49.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:42:49.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.866+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:42:49.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.890+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:42:49.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.902+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:42:49.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.914+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:42:49.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.922+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:42:49.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.942+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:42:49.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.950+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:42:49.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.974+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:42:49.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.990+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:42:49.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:49.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:42:50.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.054+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:42:50.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.054+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:42:50.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.066+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:42:50.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.070+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:50.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.082+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:42:50.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.126+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:50.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.150+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:42:50.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.158+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:42:50.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 64 15 819541 819526 800.241 756.25 0.00104617 0.0012377 2024-09-16T03:42:50.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.158+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:50.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.162+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:42:50.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.166+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:42:50.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.214+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:42:50.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.218+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:42:50.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.218+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:42:50.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.242+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:42:50.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.246+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:50.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.262+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:42:50.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.270+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:42:50.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.290+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:42:50.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.294+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:42:50.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.310+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:42:50.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.322+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:50.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.334+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:42:50.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.346+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:50.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.346+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:42:50.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.354+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:42:50.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.362+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:42:50.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.366+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:42:50.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:50.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.390+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:42:50.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.414+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:50.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.430+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:42:50.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.438+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:42:50.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.450+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:42:50.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.450+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:50.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.462+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:42:50.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.478+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:42:50.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.482+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:50.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.494+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:50.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.506+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:42:50.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.514+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:42:50.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.530+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:50.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.542+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:42:50.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.558+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:42:50.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.566+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:50.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.590+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:50.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.598+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:42:50.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.602+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:42:50.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.622+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:42:50.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.630+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:50.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.642+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:50.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.642+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:50.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.654+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:42:50.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.662+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:42:50.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.678+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:50.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.702+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:42:50.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.706+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:50.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.722+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:50.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.722+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:42:50.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.730+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:42:50.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.758+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:42:50.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.766+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:42:50.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:42:50.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.782+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:42:50.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.794+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:42:50.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.806+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:50.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.810+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:42:50.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.842+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:42:50.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.874+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:42:50.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:42:50.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.886+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:42:50.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.906+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:42:50.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:42:50.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.930+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:50.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.934+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:42:50.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.954+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:42:50.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.970+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:42:50.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.970+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:42:50.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.978+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:50.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.982+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:42:51.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:50.998+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:42:51.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.006+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:42:51.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.018+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:42:51.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.026+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:51.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.046+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:42:51.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.062+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:42:51.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.066+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:42:51.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.090+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:51.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.098+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:42:51.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.110+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:51.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.110+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:51.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:42:51.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:42:51.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:51.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 65 16 832510 832494 800.398 810.5 0.000644182 0.00123745 2024-09-16T03:42:51.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.162+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:42:51.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.166+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:51.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.186+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:51.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.194+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:51.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.202+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:42:51.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:42:51.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.238+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:51.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.250+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:51.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.250+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:51.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.254+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:51.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.278+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:51.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.286+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:42:51.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.290+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:42:51.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:42:51.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.310+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:51.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.338+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:42:51.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.350+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:42:51.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.358+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:42:51.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.362+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:42:51.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.386+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:42:51.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.402+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:42:51.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:51.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.418+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:42:51.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.426+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:42:51.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.434+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:42:51.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:42:51.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.450+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:51.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.470+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:51.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.470+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:42:51.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.474+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:42:51.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.478+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:42:51.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.490+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:51.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.510+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:42:51.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.522+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:51.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.546+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:42:51.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.554+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:42:51.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.558+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:42:51.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.562+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:42:51.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.578+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:42:51.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.582+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:42:51.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.586+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:42:51.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.594+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:42:51.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.598+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:42:51.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.602+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:42:51.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:51.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.658+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:42:51.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.658+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:42:51.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.670+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:42:51.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:42:51.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.702+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:51.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.714+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:42:51.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.722+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:42:51.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.722+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:51.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.730+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:42:51.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.738+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:42:51.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.754+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:51.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.758+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:42:51.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:42:51.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.774+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:42:51.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.790+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:42:51.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.810+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:51.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.814+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:42:51.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:42:51.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.846+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:42:51.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.854+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:42:51.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.874+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:42:51.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.878+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:42:51.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:51.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.906+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:42:51.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.922+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:51.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.926+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:51.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.926+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:42:51.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.950+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:42:51.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.958+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:42:51.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:42:51.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.978+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:42:51.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.982+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:42:51.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.990+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:42:52.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:51.998+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:42:52.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.002+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:42:52.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.034+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:42:52.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.038+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:42:52.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.054+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:42:52.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.058+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:42:52.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.062+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:42:52.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.090+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:42:52.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.102+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:42:52.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:52.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.126+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:42:52.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.146+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:42:52.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.150+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:42:52.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.154+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:42:52.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 66 16 845680 845664 800.742 823.125 0.000565571 0.0012369 2024-09-16T03:42:52.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.170+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:42:52.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.174+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:42:52.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.190+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:42:52.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.194+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:42:52.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.198+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:42:52.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:52.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.222+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:42:52.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:42:52.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.282+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:42:52.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.286+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:42:52.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.322+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:42:52.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:42:52.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.334+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:52.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:42:52.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.362+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:42:52.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.378+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:42:52.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.386+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:52.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.394+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:52.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:52.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.430+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:42:52.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.450+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:42:52.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.458+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:42:52.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.458+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:42:52.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.466+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:42:52.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.470+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:42:52.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.474+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:52.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.486+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:42:52.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.486+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:42:52.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.518+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:42:52.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.530+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:42:52.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.542+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:52.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.546+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:42:52.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.558+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:42:52.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.582+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:42:52.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.586+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:42:52.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.586+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:42:52.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.614+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:52.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.618+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:42:52.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.626+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:42:52.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.630+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:42:52.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.662+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:42:52.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.666+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:42:52.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.678+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:42:52.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.678+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:42:52.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.686+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:42:52.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.694+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:42:52.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:42:52.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.754+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:52.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.758+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:42:52.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.770+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:42:52.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.806+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:42:52.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.870+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:42:52.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:42:52.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:42:52.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.898+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:42:52.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.906+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:42:52.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.922+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:42:52.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.930+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:42:52.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.930+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:42:52.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.938+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:52.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.962+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:42:52.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.974+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:42:52.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.986+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:52.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.986+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:52.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:42:53.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:52.998+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:42:53.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.006+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:42:53.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.030+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:42:53.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.030+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:42:53.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.054+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:42:53.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.058+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:42:53.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.078+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:42:53.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.086+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:42:53.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.094+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:42:53.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.094+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:53.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.102+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:42:53.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.126+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:53.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.134+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:42:53.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.142+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:42:53.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.150+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:42:53.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.150+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:53.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 67 16 858814 858798 801.041 820.875 0.00208887 0.00123642 2024-09-16T03:42:53.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.162+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:53.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.198+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:42:53.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:42:53.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.214+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:42:53.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.226+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:53.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.230+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:42:53.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.258+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:42:53.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:42:53.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.290+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:42:53.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.290+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:42:53.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.322+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:42:53.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.326+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:53.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:42:53.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.346+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:42:53.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.358+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:42:53.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.374+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:42:53.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.394+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:42:53.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.394+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:53.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:42:53.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.430+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:42:53.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.434+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:42:53.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.442+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:53.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.450+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:42:53.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.458+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:53.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.462+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:42:53.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.498+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:42:53.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.506+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:42:53.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.510+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:42:53.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.522+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:42:53.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:42:53.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.546+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:42:53.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.566+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:42:53.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.574+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:53.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.578+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:42:53.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.578+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:42:53.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.598+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:42:53.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.598+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:42:53.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.614+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:53.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.618+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:42:53.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.626+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:42:53.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.642+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:53.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.646+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:42:53.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.654+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:42:53.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.686+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:42:53.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.690+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:53.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.694+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:42:53.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.710+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:42:53.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.734+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:42:53.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.734+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:42:53.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.762+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:42:53.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.770+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:42:53.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.782+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:53.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.786+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:42:53.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.798+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:42:53.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:53.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.830+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:53.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.830+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:42:53.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.842+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:42:53.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.854+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:42:53.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.866+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:42:53.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.882+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:42:53.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:42:53.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.894+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:42:53.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.902+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:42:53.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.910+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:53.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.926+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:42:53.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.942+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:42:53.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.946+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:42:53.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.954+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:42:53.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.978+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:53.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:53.982+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:42:54.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.002+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:42:54.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.006+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:42:54.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.014+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:42:54.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.018+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:42:54.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.030+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:42:54.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.034+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:42:54.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.038+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:42:54.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.058+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:54.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.086+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:42:54.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.090+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:42:54.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.094+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:42:54.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.114+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:42:54.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.118+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:42:54.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:54.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 68 16 871808 871792 801.203 812.125 0.000598413 0.00123622 2024-09-16T03:42:54.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.158+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:42:54.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.166+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:42:54.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.174+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:42:54.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.182+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:42:54.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:42:54.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.190+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:42:54.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.198+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:54.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.206+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:42:54.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:42:54.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.218+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:42:54.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.266+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:42:54.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:42:54.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:42:54.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.294+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:42:54.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.298+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:42:54.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:42:54.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:42:54.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.334+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:42:54.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.334+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:42:54.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.354+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:54.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.358+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:54.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.362+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:42:54.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.378+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:42:54.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.390+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:42:54.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:42:54.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.414+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:42:54.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.422+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:42:54.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.438+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:54.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.454+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:42:54.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.458+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:42:54.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.462+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:42:54.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.466+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:42:54.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.486+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:42:54.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.498+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:42:54.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.506+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:42:54.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:54.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.514+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:42:54.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.530+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:42:54.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.534+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:42:54.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.562+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:42:54.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.562+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:42:54.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.566+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:54.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.590+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:42:54.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.606+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:54.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.610+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:42:54.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.610+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:42:54.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.618+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:42:54.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.622+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:42:54.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:54.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.650+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:42:54.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:42:54.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.666+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:54.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.666+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:42:54.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.702+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:42:54.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.710+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:42:54.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.722+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:42:54.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.730+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:42:54.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.730+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:42:54.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.750+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:42:54.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.758+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:42:54.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.762+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:54.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.766+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:42:54.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.802+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:42:54.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.806+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:54.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:42:54.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.842+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:42:54.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.842+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:42:54.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.850+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:42:54.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.862+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:42:54.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.866+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:42:54.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:54.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.894+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:42:54.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:42:54.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.894+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:54.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:42:54.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.910+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:42:54.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.914+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:42:54.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:42:54.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.958+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:42:54.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:54.958+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:42:55.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:42:55.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.050+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:42:55.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.054+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:42:55.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.074+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:42:55.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.086+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:42:55.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.098+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:42:55.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.098+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:42:55.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.110+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:42:55.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.114+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:42:55.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:42:55.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.154+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:42:55.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 69 16 883751 883735 800.408 746.438 0.000525818 0.00123745 2024-09-16T03:42:55.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.166+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:42:55.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.170+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:42:55.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.186+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:42:55.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.194+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:42:55.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.206+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:42:55.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.214+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:55.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.222+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:42:55.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.242+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:42:55.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.242+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:42:55.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.270+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:42:55.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.294+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:42:55.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.298+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:42:55.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.298+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:42:55.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.306+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:55.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.330+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:42:55.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.342+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:55.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.350+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:42:55.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:42:55.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.370+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:42:55.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.394+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:42:55.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:42:55.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.410+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:42:55.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.414+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:42:55.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.426+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:42:55.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.430+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:42:55.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:42:55.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.454+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:42:55.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.458+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:42:55.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.470+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:42:55.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:55.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.498+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:42:55.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.510+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:42:55.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.522+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:42:55.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.526+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:42:55.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.538+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:42:55.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:42:55.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.562+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:42:55.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:42:55.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.570+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:55.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.586+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:42:55.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.598+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:55.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.598+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:42:55.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.610+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:55.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.610+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:42:55.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.622+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:55.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.642+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:42:55.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.646+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:42:55.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.658+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:42:55.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:42:55.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.686+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:42:55.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.686+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:42:55.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.694+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:42:55.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.722+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:42:55.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.726+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:42:55.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:42:55.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.758+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:42:55.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.758+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:42:55.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.766+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:42:55.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.766+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:42:55.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.770+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:42:55.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.802+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:42:55.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.814+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:42:55.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.814+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:55.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.834+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:42:55.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.838+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:42:55.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.842+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:55.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.850+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:42:55.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.878+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:55.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.902+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:42:55.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.902+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:42:55.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.918+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:55.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.926+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:42:55.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.934+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:42:55.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.934+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:42:55.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.942+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:42:55.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.954+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:55.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.958+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:55.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:55.982+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:56.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.002+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:42:56.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.010+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:42:56.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.026+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:42:56.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:42:56.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.050+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:42:56.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.054+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:42:56.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.062+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:42:56.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.074+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:42:56.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:42:56.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.094+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:42:56.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.098+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:42:56.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.102+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:42:56.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.118+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:42:56.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:42:56.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.138+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:42:56.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.142+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:42:56.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.150+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:42:56.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.158+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:42:56.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 70 15 896655 896640 800.495 806.562 0.000698958 0.00123728 2024-09-16T03:42:56.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.174+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:42:56.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.186+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:42:56.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:42:56.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.190+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:42:56.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.202+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:42:56.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.210+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:42:56.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.226+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:42:56.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.242+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:42:56.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.242+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:42:56.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.266+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:42:56.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.286+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:42:56.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.298+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:42:56.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.318+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:42:56.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:42:56.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.382+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:42:56.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.386+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:42:56.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.390+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:42:56.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.394+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:42:56.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.414+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:42:56.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.430+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:42:56.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.434+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:42:56.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.458+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:42:56.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.474+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:42:56.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.506+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:42:56.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:42:56.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.530+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:56.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.542+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:42:56.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:42:56.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.558+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:56.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.562+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:42:56.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.566+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:42:56.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.570+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:42:56.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.574+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:42:56.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.586+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:42:56.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:42:56.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.626+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:56.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.626+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:42:56.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.634+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:42:56.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.650+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:42:56.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.666+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:42:56.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.678+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:42:56.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.682+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:42:56.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.690+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:42:56.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.706+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:42:56.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.710+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:42:56.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.738+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:42:56.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:42:56.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.758+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:42:56.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.770+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:42:56.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.782+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:42:56.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.786+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:42:56.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.786+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:42:56.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.814+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:42:56.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.818+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:42:56.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.830+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:42:56.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.854+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:56.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.858+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:42:56.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.862+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:42:56.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.870+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:42:56.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.890+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:42:56.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.898+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:42:56.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.902+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:42:56.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.902+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:56.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.906+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:42:56.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.910+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:56.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.926+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:42:56.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.926+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:42:56.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.938+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:42:56.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.950+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:42:56.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.970+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:42:56.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.978+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:42:57.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:56.998+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:42:57.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.002+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:42:57.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.006+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:42:57.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.026+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:42:57.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.034+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:42:57.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.038+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:42:57.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.054+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:57.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.054+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:42:57.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.070+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:42:57.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:42:57.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.078+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:57.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.118+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:42:57.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:42:57.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.138+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:42:57.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.142+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:42:57.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:57.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.150+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:42:57.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 71 16 909581 909565 800.597 807.812 0.00403216 0.00123712 2024-09-16T03:42:57.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.162+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:42:57.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:42:57.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.182+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:42:57.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.202+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:42:57.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.202+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:42:57.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.202+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:42:57.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.206+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:42:57.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.214+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:57.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.222+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:42:57.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.238+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:42:57.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.270+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:42:57.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.270+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:42:57.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.290+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:42:57.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.302+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:42:57.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.306+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:42:57.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.318+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:42:57.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.326+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:42:57.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.354+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:57.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.358+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:42:57.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:42:57.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.374+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:42:57.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.378+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:42:57.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.382+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:42:57.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.386+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:42:57.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:42:57.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.402+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:42:57.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.414+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:42:57.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.426+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:42:57.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.430+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:42:57.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.446+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:42:57.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.454+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:42:57.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.466+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:42:57.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:42:57.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.510+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:42:57.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:42:57.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.522+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:42:57.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.546+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:42:57.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.566+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:42:57.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.570+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:42:57.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.574+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:42:57.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.586+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:42:57.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.586+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:42:57.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.590+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:42:57.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:42:57.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.642+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:42:57.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.642+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:42:57.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:42:57.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.670+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:57.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.674+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:42:57.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.686+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:42:57.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.698+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:42:57.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.702+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:42:57.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.706+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:42:57.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.718+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:42:57.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.722+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:42:57.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.734+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:42:57.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.758+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:42:57.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.770+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:42:57.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.778+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:42:57.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:42:57.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.802+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:42:57.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.814+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:57.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.842+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:42:57.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:42:57.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.854+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:57.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.878+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:42:57.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.898+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:42:57.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.910+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:42:57.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.910+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:42:57.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:57.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.930+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:42:57.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.954+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:42:57.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:42:57.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.962+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:42:57.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.962+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:42:57.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.974+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:42:57.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.990+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:58.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:57.998+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:42:58.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.010+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:42:58.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.030+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:42:58.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.034+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:42:58.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.042+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:42:58.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.046+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:42:58.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.074+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:42:58.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.082+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:42:58.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.086+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:42:58.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.094+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:42:58.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.122+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:42:58.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.130+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:42:58.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.138+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:42:58.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.138+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:42:58.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 72 16 922329 922313 800.543 796.75 0.0008002 0.00123721 2024-09-16T03:42:58.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.158+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:42:58.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.178+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:42:58.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.186+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:42:58.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.190+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:42:58.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.194+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:42:58.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:42:58.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.210+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:42:58.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.238+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:42:58.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.242+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:42:58.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.266+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:42:58.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.270+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:42:58.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.274+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:42:58.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.282+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:42:58.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.298+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:42:58.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.302+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:42:58.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.306+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:42:58.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.310+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:42:58.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.334+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:58.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.338+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:42:58.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.342+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:42:58.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.378+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:42:58.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.382+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:42:58.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.406+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:42:58.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.406+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:58.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.406+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:42:58.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.418+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:42:58.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.450+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:42:58.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.462+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:42:58.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.482+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:58.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.506+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:42:58.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.514+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:42:58.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.522+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:42:58.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.526+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:42:58.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.534+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:42:58.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.546+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:58.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.554+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:42:58.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.554+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:42:58.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:42:58.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.602+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:42:58.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:42:58.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.630+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:42:58.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.642+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:42:58.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:42:58.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.666+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:42:58.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.674+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:42:58.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.678+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:42:58.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.694+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:42:58.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.726+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:42:58.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.726+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:42:58.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.746+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:42:58.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.750+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:42:58.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.750+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:42:58.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.754+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:42:58.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.766+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:42:58.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.778+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:42:58.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.782+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:42:58.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.806+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:42:58.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.818+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:58.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.818+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:42:58.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.826+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:42:58.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.834+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:42:58.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:42:58.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.862+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:42:58.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:58.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:42:58.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.914+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:42:58.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.914+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:42:58.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.922+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:42:58.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:42:58.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.962+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:42:58.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.970+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:42:58.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:58.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.986+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:42:58.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:58.986+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:42:59.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.006+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:42:59.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.014+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:42:59.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.042+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:42:59.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.042+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:42:59.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.046+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:42:59.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.054+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:42:59.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.074+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:42:59.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:42:59.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.094+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:42:59.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.098+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:42:59.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:42:59.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.130+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:42:59.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.142+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:42:59.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:42:59.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.154+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:42:59.161 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 73 16 935130 935114 800.536 800.062 0.00105563 0.00123725 2024-09-16T03:42:59.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.174+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:42:59.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.190+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:42:59.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.194+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:42:59.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.202+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:42:59.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.214+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:42:59.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.226+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:42:59.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.234+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:42:59.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.250+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:42:59.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.258+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:42:59.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.266+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:42:59.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.282+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:42:59.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.286+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:42:59.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.294+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:42:59.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.294+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:42:59.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.298+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:42:59.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.306+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:42:59.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.338+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:42:59.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.350+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:42:59.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.358+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:42:59.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:42:59.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.378+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:42:59.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.390+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:42:59.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.410+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:42:59.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.422+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:42:59.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.438+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:42:59.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.442+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:42:59.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.450+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:42:59.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:42:59.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.478+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:42:59.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:42:59.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.498+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:42:59.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.506+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:42:59.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.530+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:42:59.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.534+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:42:59.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.538+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:42:59.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.546+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:42:59.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.550+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:42:59.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.566+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:42:59.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.582+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:42:59.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.582+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:42:59.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.606+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:42:59.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.614+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:42:59.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:42:59.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.638+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:42:59.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.642+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:42:59.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.646+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:42:59.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.670+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:42:59.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.682+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:42:59.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.686+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:42:59.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:42:59.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.702+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:42:59.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:42:59.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.714+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:42:59.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.738+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:42:59.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.742+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:42:59.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.750+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:42:59.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.766+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:42:59.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.798+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:42:59.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.802+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:42:59.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.830+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:42:59.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.830+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:42:59.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.838+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:42:59.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:42:59.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.870+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:42:59.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:42:59.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.894+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:42:59.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.914+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:42:59.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.914+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:42:59.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.934+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:42:59.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:42:59.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.942+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:42:59.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.942+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:42:59.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.958+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:42:59.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.966+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:42:59.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:42:59.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:43:00.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:43:00.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:43:00.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.014+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:00.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:00.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.042+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:43:00.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.042+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:43:00.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.054+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:43:00.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:43:00.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:00.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.118+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:43:00.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.122+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:43:00.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.122+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:43:00.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.150+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:43:00.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 74 15 947444 947429 800.118 769.688 0.000887011 0.00123783 2024-09-16T03:43:00.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.170+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:43:00.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:00.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.186+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:00.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.202+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:43:00.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.206+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:43:00.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.214+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:43:00.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.246+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:43:00.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.258+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:43:00.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.270+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:00.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.278+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:43:00.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.286+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:43:00.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.294+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:43:00.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.302+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:43:00.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.310+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:00.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.318+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:43:00.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.318+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:00.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.338+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:43:00.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.358+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:43:00.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.362+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:43:00.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:00.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.390+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:43:00.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.394+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:43:00.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.398+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:43:00.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.406+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:43:00.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.410+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:43:00.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.418+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:43:00.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.450+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:43:00.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.470+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:00.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.474+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:43:00.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.490+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:00.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.510+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:43:00.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.534+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:43:00.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.538+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:43:00.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.550+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:43:00.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.566+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:43:00.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:43:00.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:00.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.582+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:43:00.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.598+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:00.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.606+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:43:00.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.626+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:43:00.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.654+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:43:00.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.662+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:43:00.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.690+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:00.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.718+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:00.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.734+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:00.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.742+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:43:00.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.746+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:43:00.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.746+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:43:00.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.762+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:43:00.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.762+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:43:00.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:43:00.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.786+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:00.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.794+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:43:00.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.814+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:43:00.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.822+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:43:00.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.830+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:43:00.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.838+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:43:00.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.842+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:00.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.854+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:00.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:00.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.878+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:43:00.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:43:00.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.882+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:43:00.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.898+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:43:00.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.906+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:43:00.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.914+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:00.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.918+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:00.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.926+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:43:00.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.970+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:43:00.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:00.974+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:43:01.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.018+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:01.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.026+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:43:01.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:43:01.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:01.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.054+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:01.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.070+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:43:01.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.082+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:43:01.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.094+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:01.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.110+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:43:01.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.122+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:01.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:43:01.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.146+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:43:01.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 75 16 960617 960601 800.425 823.25 0.00094615 0.0012374 2024-09-16T03:43:01.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:43:01.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.174+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:01.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:01.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.186+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:01.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.190+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:01.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:43:01.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.234+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:43:01.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.234+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:43:01.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.250+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:43:01.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.258+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:01.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.282+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:01.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.282+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:43:01.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.290+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:01.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.314+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:43:01.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.318+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:01.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.330+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:43:01.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.334+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:01.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.342+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:43:01.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.378+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:01.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:43:01.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.418+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:01.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.442+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:01.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.446+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:43:01.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.454+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:43:01.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.466+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:43:01.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.478+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:43:01.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.490+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:43:01.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.490+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:43:01.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:01.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:43:01.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.530+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:43:01.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:01.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.546+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:01.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.558+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:43:01.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.562+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:01.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.562+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:01.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:43:01.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.590+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:43:01.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.606+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:01.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.610+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:01.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.638+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:43:01.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.642+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:01.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.646+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:43:01.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.670+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:43:01.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.682+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:43:01.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.694+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:01.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.722+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:01.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.750+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:43:01.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.750+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:43:01.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:43:01.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.778+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:43:01.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.786+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:43:01.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.794+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:01.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.818+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:43:01.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.818+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:43:01.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.830+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:01.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.834+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:01.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.838+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:01.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.874+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:01.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.882+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:43:01.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.902+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:43:01.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.902+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:01.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.910+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:43:01.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.922+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:01.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.938+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:43:01.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.942+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:01.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:01.986+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:02.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.022+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:43:02.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.022+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:02.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.026+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:43:02.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.054+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:43:02.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.062+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:43:02.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.066+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:02.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.070+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:43:02.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.086+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:43:02.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.106+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:43:02.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.114+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:43:02.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.122+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:02.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.134+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:02.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.142+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:43:02.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.142+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:02.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 76 16 973800 973784 800.734 823.938 0.00065135 0.00123693 2024-09-16T03:43:02.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.170+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:02.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:43:02.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.190+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:02.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.246+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:43:02.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.246+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:43:02.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.254+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:02.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.254+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:43:02.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.266+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:43:02.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:43:02.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.282+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:43:02.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.294+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:43:02.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.318+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:43:02.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.322+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:02.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.326+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:02.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.338+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:02.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.362+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:02.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.366+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:43:02.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.382+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:02.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.386+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:43:02.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.394+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:43:02.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.394+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:02.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.422+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:43:02.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.426+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:43:02.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.430+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:43:02.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.438+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:43:02.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.454+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:43:02.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.474+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:43:02.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.478+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:43:02.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.502+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:43:02.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.506+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:43:02.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.534+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:02.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.534+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:43:02.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.538+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:43:02.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.562+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:02.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.574+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:43:02.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.590+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:43:02.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.594+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:02.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.602+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:43:02.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.602+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:43:02.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.606+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:43:02.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.630+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:02.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.630+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:02.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.642+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:02.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.646+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:43:02.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.666+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:02.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.670+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:43:02.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.674+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:02.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.678+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:02.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.686+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:43:02.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.694+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:43:02.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:43:02.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.726+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:43:02.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.730+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:02.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.730+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:43:02.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.746+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:02.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.746+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:43:02.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.754+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:02.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:02.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.790+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:43:02.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.806+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:02.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.810+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:02.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.826+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:43:02.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.834+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:43:02.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.874+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:43:02.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.874+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:02.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.898+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:43:02.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.902+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:43:02.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.902+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:02.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.914+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:43:02.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.938+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:02.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.954+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:43:02.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.966+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:02.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:02.990+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:03.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.002+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:03.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.006+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:43:03.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.010+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:03.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.014+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:03.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.014+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:43:03.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.018+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:03.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.038+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:03.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.062+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:43:03.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.070+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:43:03.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.090+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:43:03.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.094+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:43:03.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.114+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:03.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.114+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:43:03.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.138+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:43:03.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.138+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:43:03.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.146+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:43:03.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.150+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:43:03.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 77 16 986803 986787 800.888 812.688 0.000990187 0.00123667 2024-09-16T03:43:03.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.162+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:03.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.170+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:03.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.202+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:43:03.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:43:03.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.210+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:03.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.214+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:43:03.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.214+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:43:03.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.230+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:03.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.242+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:03.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.258+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:43:03.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.262+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:43:03.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:43:03.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.294+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:03.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.306+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:43:03.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.314+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:43:03.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.330+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:03.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.330+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:03.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.330+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:03.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.354+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:43:03.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.358+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:03.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.378+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:43:03.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.390+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:43:03.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.402+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:03.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:43:03.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.406+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:43:03.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.426+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:43:03.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.442+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:43:03.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.450+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:43:03.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.462+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:03.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.474+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:43:03.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.486+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:03.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.498+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:03.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.502+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:43:03.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.514+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:43:03.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.514+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:03.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.522+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:43:03.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.534+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:03.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:43:03.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:43:03.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.590+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:43:03.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.594+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:43:03.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.610+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:03.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.614+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:43:03.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.626+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:43:03.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.626+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:43:03.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.658+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:43:03.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.658+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:43:03.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.674+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:03.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.694+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:43:03.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.710+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:43:03.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.718+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:43:03.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.726+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:03.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.730+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:43:03.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.734+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:03.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.746+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:43:03.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.758+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:43:03.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:03.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.766+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:43:03.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.782+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:03.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.818+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:43:03.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.826+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:43:03.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:43:03.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.830+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:43:03.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.850+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:03.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.870+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:43:03.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.870+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:43:03.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.898+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:43:03.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.910+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:43:03.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.914+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:43:03.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.922+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:43:03.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.954+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:43:03.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.962+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:43:03.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:43:03.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:03.970+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:43:04.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.006+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:43:04.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.006+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:43:04.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:43:04.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.010+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:43:04.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:43:04.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.034+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:43:04.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.050+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:43:04.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.050+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:43:04.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.054+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:04.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:43:04.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:43:04.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.098+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:43:04.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.110+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:43:04.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:04.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.130+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:04.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.158+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:43:04.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 78 15 999410 999395 800.722 788 0.00148882 0.00123698 2024-09-16T03:43:04.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.170+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:04.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.186+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:04.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.190+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:43:04.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.206+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:43:04.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.210+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:04.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:04.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.230+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:04.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:43:04.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.254+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:43:04.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.258+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:04.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.266+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:43:04.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:43:04.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.286+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:04.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.286+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:43:04.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.294+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:04.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.294+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:43:04.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.306+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:43:04.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.322+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:43:04.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.330+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:43:04.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.342+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:43:04.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.346+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:43:04.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.350+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:43:04.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.354+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:04.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.394+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:43:04.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.406+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:43:04.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.406+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:43:04.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.418+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:43:04.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.438+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:43:04.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:43:04.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.450+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:04.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.462+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:04.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.470+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:43:04.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.482+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:43:04.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.486+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:43:04.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.490+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:43:04.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.506+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:04.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.522+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:04.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.534+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:43:04.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.550+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:43:04.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.570+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:43:04.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.570+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:43:04.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.590+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:43:04.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.646+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:43:04.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.646+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:04.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.650+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:43:04.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.654+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:04.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.690+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:43:04.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.690+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:43:04.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.706+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:04.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.714+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:04.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.730+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:04.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.742+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:04.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.758+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:43:04.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.758+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:43:04.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.774+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:04.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.810+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:43:04.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:43:04.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.814+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:04.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.830+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:04.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.842+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:04.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:43:04.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.858+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:43:04.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.866+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:43:04.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.886+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:43:04.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.886+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:43:04.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.894+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:43:04.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.894+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:04.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.918+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:43:04.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.930+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:43:04.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.938+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:43:04.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.950+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:43:04.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.962+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:04.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.990+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:43:04.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:04.994+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:43:05.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.018+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:43:05.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.054+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:05.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.070+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:43:05.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:05.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.082+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:05.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.102+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:05.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.106+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:43:05.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:43:05.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.142+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:05.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.150+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:43:05.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 79 16 1010915 1010899 799.687 719 0.00149814 0.00123857 2024-09-16T03:43:05.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.190+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:43:05.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.190+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:05.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.198+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:05.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.210+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:43:05.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.218+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:43:05.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.222+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:43:05.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.234+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:05.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.242+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:05.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.266+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:43:05.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:05.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.290+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:05.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.302+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:43:05.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.314+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:05.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.334+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:43:05.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.342+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:43:05.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:43:05.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.350+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:43:05.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.374+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:05.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.378+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:05.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:05.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.410+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:43:05.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.414+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:43:05.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.430+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:05.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.446+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:43:05.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.470+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:05.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.478+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:05.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:43:05.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:43:05.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.514+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:43:05.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:05.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.550+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:05.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.558+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:43:05.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.566+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:05.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.574+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:43:05.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.586+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:43:05.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.602+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:43:05.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.622+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:05.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.626+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:05.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.638+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:05.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.638+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:43:05.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.650+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:05.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.670+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:05.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.686+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:05.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.698+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:43:05.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.730+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:43:05.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.742+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:43:05.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:43:05.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:43:05.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.774+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:05.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.794+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:43:05.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.794+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:43:05.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:05.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.826+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:43:05.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.826+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:05.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:43:05.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.838+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:05.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.846+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:43:05.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.858+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:43:05.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:43:05.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.878+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:43:05.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.890+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:05.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.902+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:05.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.918+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:43:05.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.930+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:43:05.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.950+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:43:05.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.958+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:05.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.966+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:43:05.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.978+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:05.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:05.994+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:43:06.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.006+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:43:06.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.010+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:43:06.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.026+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:06.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.058+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:43:06.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.058+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:43:06.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.070+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:06.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.078+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:06.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.082+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:06.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.086+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:43:06.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.114+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:06.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:43:06.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.146+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:43:06.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.146+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:43:06.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:43:06.161915+0000 min lat: 0.000239237 max lat: 0.129137 avg lat: 0.00123845 2024-09-16T03:43:06.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:43:06.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 80 15 1023805 1023790 799.761 805.688 0.00183802 0.00123845 2024-09-16T03:43:06.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.162+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:43:06.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.170+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:43:06.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.202+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:43:06.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:06.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.210+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:06.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:06.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.218+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:43:06.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.242+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:06.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.246+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:06.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.254+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:43:06.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.258+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:06.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.282+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:43:06.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:06.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.318+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:43:06.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.338+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:43:06.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.370+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:43:06.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.382+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:43:06.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.402+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:43:06.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.414+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:06.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.426+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:43:06.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.442+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:43:06.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.442+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:43:06.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.446+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:06.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.470+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:43:06.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.478+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:06.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.486+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:06.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.502+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:43:06.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.514+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:06.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.518+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:43:06.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.530+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:43:06.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:06.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.558+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:43:06.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.558+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:43:06.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.578+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:06.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.590+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:43:06.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.590+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:43:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.606+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:06.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.610+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:43:06.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.634+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:43:06.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.654+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:06.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.662+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:06.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.694+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:43:06.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:43:06.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.714+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:43:06.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.718+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:43:06.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.746+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:06.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.766+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:43:06.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:43:06.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.786+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:06.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.798+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:43:06.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.806+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:06.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.818+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:43:06.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.834+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:06.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.846+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:43:06.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:43:06.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.882+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:43:06.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:43:06.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.902+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:43:06.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.906+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:43:06.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:06.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.930+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:43:06.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.934+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:06.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.950+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:06.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:43:06.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.966+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:06.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.970+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:43:06.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.974+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:43:06.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:06.990+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:07.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:43:07.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.034+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:07.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:43:07.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.034+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:43:07.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.058+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:07.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.074+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:43:07.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.082+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:07.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.094+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:43:07.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.094+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:43:07.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.098+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:07.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.114+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:43:07.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.138+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:43:07.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.138+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:07.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.150+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:07.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 81 16 1036910 1036894 799.997 819 0.00104074 0.00123811 2024-09-16T03:43:07.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:07.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.182+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:07.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.194+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:43:07.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:43:07.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.222+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:43:07.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.226+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:07.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.238+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:07.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.258+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:43:07.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.270+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:43:07.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.274+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:07.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.298+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:07.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.314+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:43:07.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.346+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:07.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.346+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:43:07.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:07.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:43:07.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.374+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:43:07.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.382+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:07.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.394+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:07.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.418+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:07.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.422+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:07.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.434+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:43:07.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.450+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:43:07.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.454+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:43:07.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.470+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:43:07.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.486+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:43:07.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.490+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:43:07.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.498+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:43:07.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.518+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:43:07.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:07.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.526+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:43:07.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.526+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:07.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:43:07.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.554+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:07.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.574+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:43:07.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.578+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:43:07.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.590+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:43:07.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.598+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:07.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.610+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:43:07.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.622+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:43:07.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.626+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:43:07.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.626+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:43:07.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.666+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:07.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.682+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:43:07.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.686+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:43:07.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.702+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:07.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.718+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:43:07.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.730+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:43:07.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.742+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:43:07.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.746+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:43:07.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.750+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:07.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.758+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:07.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.782+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:07.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.782+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:07.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.798+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:43:07.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:07.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.826+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:43:07.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:43:07.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.850+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:07.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.858+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:43:07.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.858+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:43:07.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.866+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:43:07.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.898+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:43:07.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.902+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:07.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.902+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:43:07.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.926+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:43:07.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:07.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.946+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:43:07.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.966+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:07.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.982+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:07.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.986+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:43:08.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:07.994+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:08.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.018+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:08.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.030+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:08.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:43:08.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.054+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:08.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.062+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:08.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.066+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:43:08.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:43:08.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.110+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:43:08.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.110+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:43:08.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:43:08.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.130+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:43:08.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.134+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:43:08.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.150+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:43:08.162 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 82 16 1050314 1050298 800.457 837.75 0.00112063 0.00123739 2024-09-16T03:43:08.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.162+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:43:08.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.162+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:43:08.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.174+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:43:08.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.178+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:43:08.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.202+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:43:08.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.206+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:08.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.218+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:43:08.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.230+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:43:08.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.238+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:43:08.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.242+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:43:08.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.254+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:43:08.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.278+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:43:08.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.278+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:43:08.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.286+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:43:08.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.298+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:43:08.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.318+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:08.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.330+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:43:08.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.350+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:43:08.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.358+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:43:08.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.370+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:43:08.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:43:08.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.390+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:43:08.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.394+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:43:08.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.398+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:43:08.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.422+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:43:08.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.434+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:08.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.442+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:43:08.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.446+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:08.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.470+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:08.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.478+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:08.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.478+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:08.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.482+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:08.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.494+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:08.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.510+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:43:08.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:43:08.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.522+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:43:08.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.550+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:08.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.570+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:08.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.578+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:43:08.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:08.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.602+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:43:08.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.606+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:43:08.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.614+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:43:08.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.626+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:08.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.658+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:08.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.702+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:43:08.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.706+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:08.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.734+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:43:08.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.766+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:43:08.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.782+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:43:08.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.798+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:43:08.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.798+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:08.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.814+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:43:08.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.826+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:08.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.842+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:43:08.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.866+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:43:08.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.870+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:43:08.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.890+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:08.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:08.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.906+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:08.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.914+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:43:08.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.926+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:43:08.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.938+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:08.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.942+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:43:08.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.942+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:43:08.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:08.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.970+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:43:08.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.986+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:08.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:08.990+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:43:09.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.002+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:43:09.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.010+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:09.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.026+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:43:09.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.034+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:09.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.054+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:43:09.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.054+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:09.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.066+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:09.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.082+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:09.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.086+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:43:09.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.098+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:43:09.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.110+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:09.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:43:09.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:43:09.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.150+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:43:09.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.158+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:43:09.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 83 16 1063654 1063638 800.857 833.75 0.00356256 0.00123676 2024-09-16T03:43:09.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.166+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:43:09.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.166+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:09.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.178+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:43:09.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.202+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:09.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.222+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:43:09.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:43:09.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.246+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:43:09.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.270+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:43:09.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:43:09.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.298+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:43:09.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:43:09.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.306+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:09.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.306+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:09.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.306+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:09.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.334+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:43:09.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.354+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:43:09.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.358+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:43:09.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.366+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:43:09.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.378+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:43:09.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.382+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:43:09.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.402+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:43:09.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.406+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:43:09.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.406+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:43:09.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:43:09.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.442+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:09.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.442+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:43:09.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.458+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:43:09.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.474+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:43:09.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.486+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:43:09.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:09.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:43:09.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.526+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:09.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.534+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:43:09.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:43:09.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.550+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:09.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.566+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:43:09.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.590+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:43:09.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.590+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:09.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.610+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:09.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.614+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:43:09.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.622+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:43:09.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.638+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:09.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.638+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:43:09.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.662+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:43:09.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.670+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:09.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.710+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:43:09.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.718+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:43:09.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.722+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:43:09.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.722+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:43:09.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.722+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:43:09.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:43:09.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.754+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:43:09.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.770+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:09.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:09.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.778+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:43:09.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.798+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:43:09.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.810+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:09.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:09.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.842+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:43:09.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.846+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:09.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.846+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:09.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.850+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:43:09.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:43:09.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.866+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:43:09.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.878+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:43:09.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:09.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.914+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:43:09.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.918+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:43:09.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.938+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:09.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.938+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:09.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.950+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:09.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.954+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:43:09.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.974+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:43:09.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:09.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:43:10.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.022+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:10.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.022+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:10.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.062+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:10.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:43:10.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.126+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:10.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.134+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:43:10.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:10.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 84 16 1076441 1076425 800.836 799.188 0.000489983 0.00123681 2024-09-16T03:43:10.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.162+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:43:10.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.178+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:43:10.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.202+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:43:10.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.206+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:43:10.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.210+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:43:10.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.230+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:10.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.242+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:10.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.246+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:43:10.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.258+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:43:10.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:43:10.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.286+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:10.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.286+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:10.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.294+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:43:10.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.314+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:43:10.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.314+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:43:10.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.334+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:43:10.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.334+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:43:10.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.342+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:10.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.358+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:43:10.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.366+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:10.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:10.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.382+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:10.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:43:10.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.410+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:43:10.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.426+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:10.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.438+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:43:10.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.442+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:43:10.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.454+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:10.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:10.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.486+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:43:10.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.498+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:10.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.506+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:43:10.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.510+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:10.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.510+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:43:10.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.518+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:43:10.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.522+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:10.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:10.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.550+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:43:10.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.566+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:43:10.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.566+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:10.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.570+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:43:10.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.586+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:10.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.586+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:43:10.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.594+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:10.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.614+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:10.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.614+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:43:10.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.618+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:10.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.626+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:43:10.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:10.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.654+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:43:10.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.662+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:43:10.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.670+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:43:10.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.702+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:10.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.726+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:43:10.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.730+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:43:10.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.738+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:43:10.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.742+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:43:10.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.770+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:43:10.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.790+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:43:10.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.790+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:10.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:10.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:43:10.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.822+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:43:10.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.830+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:43:10.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:10.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.862+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:43:10.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.862+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:43:10.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.874+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:43:10.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.882+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:43:10.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.918+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:43:10.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.922+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:10.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.930+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:10.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.950+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:43:10.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.954+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:43:10.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.974+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:10.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.978+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:43:10.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.990+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:10.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.994+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:10.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:10.994+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:11.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.026+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:11.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.030+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:43:11.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:11.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.054+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:43:11.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.062+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:43:11.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.074+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:43:11.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.074+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:43:11.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:43:11.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.090+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:11.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:11.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.122+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:11.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.138+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:43:11.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:11.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.154+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:43:11.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 85 15 1089324 1089309 800.888 805.25 0.0180424 0.00123672 2024-09-16T03:43:11.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.174+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:43:11.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.174+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:43:11.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.178+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:11.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.178+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:43:11.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.206+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:43:11.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.206+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:11.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.210+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:11.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.214+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:43:11.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.226+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:11.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.242+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:43:11.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.262+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:43:11.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.262+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:43:11.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.290+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:11.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.290+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:43:11.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.318+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:43:11.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.322+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:11.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:43:11.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.342+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:43:11.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.350+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:11.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.358+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:43:11.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.370+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:43:11.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.374+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:11.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.398+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:43:11.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.402+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:43:11.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:11.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.414+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:43:11.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.414+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:11.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:43:11.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.454+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:11.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.458+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:43:11.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.474+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:43:11.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.474+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:43:11.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.482+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:11.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.482+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:11.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.514+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:11.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.514+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:43:11.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:11.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:43:11.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.554+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:11.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.554+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:43:11.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.558+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:11.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.582+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:11.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.602+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:43:11.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.614+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:43:11.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.626+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:43:11.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.634+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:11.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:43:11.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:43:11.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.666+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:43:11.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.690+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:43:11.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.710+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:43:11.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.718+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:43:11.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.742+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:43:11.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.746+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:43:11.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.750+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:43:11.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.778+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:43:11.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.778+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:11.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.778+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:43:11.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.810+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:43:11.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.818+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:43:11.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.826+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:43:11.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.838+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:43:11.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.838+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:11.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.846+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:11.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:43:11.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.894+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:43:11.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.898+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:11.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.914+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:11.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.938+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:11.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.942+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:11.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.954+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:43:11.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.966+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:43:11.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.970+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:43:11.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:11.986+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:12.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.002+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:12.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.014+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:12.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.018+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:43:12.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.022+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:12.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.042+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:12.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.054+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:43:12.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.086+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:12.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.086+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:12.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.094+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:12.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.114+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:43:12.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:43:12.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.134+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:43:12.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.142+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:43:12.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:12.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.146+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:12.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.158+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:12.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 86 15 1102294 1102279 801 810.625 0.000465524 0.00123652 2024-09-16T03:43:12.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.178+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:12.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.178+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:43:12.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.206+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:43:12.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.218+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:43:12.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.226+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:12.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.254+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:43:12.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.262+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:43:12.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.274+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:12.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.282+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:12.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.302+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:43:12.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.314+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:43:12.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.326+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:43:12.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:43:12.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.338+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:43:12.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:12.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.378+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:43:12.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.386+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:12.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.398+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:43:12.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.406+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:12.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.410+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:12.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.426+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:43:12.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.434+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:12.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.446+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:12.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:12.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.462+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:12.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.470+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:12.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.498+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:43:12.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.502+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:43:12.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.510+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:43:12.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.522+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:12.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.526+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:43:12.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:43:12.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.542+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:43:12.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.554+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:12.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.578+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:43:12.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.594+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:12.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.610+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:12.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.618+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:43:12.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.622+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:43:12.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.638+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:12.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.646+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:43:12.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.662+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:43:12.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.710+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:43:12.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:43:12.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.726+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:43:12.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.730+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:12.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.738+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:43:12.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.754+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:43:12.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.762+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:43:12.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.766+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:43:12.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.766+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:43:12.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.782+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:43:12.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.794+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:43:12.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.798+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:43:12.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.802+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:43:12.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.866+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:12.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.866+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:12.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:43:12.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.882+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:12.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.906+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:12.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.918+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:12.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.926+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:43:12.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.934+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:43:12.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:12.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.946+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:43:12.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.954+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:12.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.954+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:12.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:12.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:12.990+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:13.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.006+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:13.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.010+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:43:13.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.038+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:43:13.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:43:13.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.054+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:43:13.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.078+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:13.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.086+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:13.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.090+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:43:13.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.098+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:13.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.102+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:43:13.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.110+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:43:13.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:43:13.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.154+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:43:13.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 87 15 1115517 1115502 801.292 826.438 0.00123437 0.00123609 2024-09-16T03:43:13.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.162+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:43:13.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.170+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:13.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.178+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:43:13.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.186+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:43:13.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.190+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:43:13.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.190+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:43:13.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.198+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:43:13.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.218+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:13.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.246+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:13.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.254+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:43:13.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.274+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:13.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.274+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:13.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.278+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:43:13.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.294+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:43:13.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.302+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:43:13.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.314+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:13.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.326+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:13.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.330+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:43:13.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.338+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:43:13.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.354+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:43:13.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.358+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:43:13.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:43:13.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.386+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:43:13.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.390+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:43:13.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.418+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:13.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.418+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:13.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.422+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:13.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.446+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:43:13.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.458+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:43:13.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.462+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:43:13.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.470+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:43:13.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.478+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:13.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.486+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:13.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:43:13.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.498+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:13.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:13.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.534+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:13.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.542+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:43:13.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.542+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:13.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.554+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:13.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.558+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:13.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.570+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:13.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:13.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.610+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:43:13.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.618+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:13.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.642+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:43:13.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.646+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:13.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.650+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:43:13.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.658+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:13.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.658+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:13.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.690+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:13.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.694+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:13.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.694+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:43:13.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.702+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:43:13.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.734+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:43:13.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.754+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:43:13.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.754+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:43:13.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.778+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:43:13.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.786+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:43:13.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.786+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:13.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.814+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:43:13.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.822+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:43:13.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.826+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:13.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.830+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:13.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.834+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:43:13.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.850+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:13.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.854+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:43:13.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:43:13.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.882+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:43:13.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.890+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:43:13.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.890+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:13.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.910+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:43:13.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.922+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:43:13.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.938+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:43:13.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.942+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:13.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.958+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:13.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:43:13.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:43:13.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:13.994+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:14.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:14.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:43:14.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.022+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:14.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.026+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:43:14.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.062+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:14.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.066+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:43:14.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.070+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:43:14.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.110+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:43:14.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.114+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:43:14.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.118+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:43:14.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.130+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:43:14.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.130+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:14.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.134+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:43:14.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.158+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:14.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 88 16 1128433 1128417 801.358 807.188 0.00130362 0.00123598 2024-09-16T03:43:14.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.182+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:43:14.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.194+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:43:14.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.198+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:43:14.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.206+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:43:14.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.246+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:14.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.250+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:14.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.258+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:14.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.286+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:43:14.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.310+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:14.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.310+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:43:14.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.314+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:43:14.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.314+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:43:14.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.338+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:14.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.342+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:14.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.350+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:14.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:43:14.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.370+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:14.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.390+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:43:14.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.430+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:43:14.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.450+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:14.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.450+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:14.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.458+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:43:14.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.474+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:43:14.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.478+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:43:14.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.502+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:43:14.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.502+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:14.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.506+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:43:14.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.510+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:14.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.526+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:43:14.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.538+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:14.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.650+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:14.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.662+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:43:14.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.670+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:43:14.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.670+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:43:14.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.702+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:14.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.706+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:14.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:43:14.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.746+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:14.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.762+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:14.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.778+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:43:14.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.782+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:43:14.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.798+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:14.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:14.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.810+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:14.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:14.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.850+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:43:14.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.866+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:43:14.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.870+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:43:14.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:43:14.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.874+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:14.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.882+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:43:14.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.898+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:43:14.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:43:14.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.926+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:43:14.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.946+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:43:14.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.954+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:14.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.974+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:43:14.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:14.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:14.994+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:15.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.002+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:43:15.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.002+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:43:15.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.034+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:43:15.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.038+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:43:15.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:43:15.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.054+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:43:15.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.062+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:43:15.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.074+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:43:15.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.082+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:43:15.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.102+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:43:15.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.134+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:15.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.142+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:15.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.146+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:43:15.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 89 16 1140297 1140281 800.685 741.5 0.0009141 0.00123703 2024-09-16T03:43:15.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.170+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:43:15.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.178+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:43:15.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.190+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:15.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.210+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:15.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.222+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:43:15.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.234+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:43:15.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.238+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:43:15.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.246+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:43:15.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.250+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:43:15.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:15.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:43:15.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.302+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:43:15.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.310+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:43:15.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.310+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:43:15.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.338+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:43:15.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.346+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:43:15.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.370+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:15.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.394+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:43:15.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.398+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:15.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:43:15.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.414+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:43:15.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.422+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:43:15.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.466+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:43:15.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.466+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:15.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:43:15.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.498+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:43:15.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.498+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:43:15.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.510+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:15.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.518+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:43:15.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.542+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:15.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.546+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:15.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.546+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:43:15.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.578+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:43:15.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:43:15.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.582+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:43:15.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.606+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:43:15.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.618+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:43:15.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.646+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:15.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.646+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:43:15.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.646+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:43:15.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.658+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:43:15.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.670+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:43:15.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.674+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:43:15.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.694+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:43:15.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.722+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:43:15.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.722+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:43:15.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.738+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:43:15.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.786+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:43:15.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.798+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:43:15.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.822+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:43:15.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.834+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:15.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.854+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:43:15.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.862+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:15.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.862+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:43:15.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:43:15.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.874+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:43:15.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.910+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:43:15.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.914+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:15.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.926+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:15.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.942+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:43:15.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.946+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:15.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.950+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:15.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:15.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.974+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:43:15.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.982+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:43:16.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.998+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:43:16.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:15.998+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:43:16.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.022+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:43:16.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.026+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:16.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.030+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:16.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.038+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:16.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.042+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:43:16.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.066+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:16.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.066+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:43:16.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:43:16.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.086+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:43:16.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.118+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:43:16.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.122+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:43:16.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.122+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:43:16.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.142+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:16.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.150+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:43:16.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 90 16 1153511 1153495 800.964 825.875 0.00146204 0.0012366 2024-09-16T03:43:16.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:43:16.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.178+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:16.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.182+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:43:16.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:43:16.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.190+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:43:16.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.194+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:16.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.198+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:43:16.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.246+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:16.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.254+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:43:16.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.258+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:16.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:43:16.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.270+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:43:16.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.274+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:43:16.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.286+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:16.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.302+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:16.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.326+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:43:16.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:43:16.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.334+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:43:16.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.378+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:43:16.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.386+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:16.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.390+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:43:16.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.410+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:43:16.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.414+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:16.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.422+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:16.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.430+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:43:16.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.438+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:16.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.454+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:16.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.458+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:16.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:16.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:43:16.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.482+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:43:16.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.514+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:16.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:43:16.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:43:16.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.542+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:16.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.546+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:43:16.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.558+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:43:16.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.558+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:43:16.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.586+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:43:16.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.602+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:16.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.610+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:43:16.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.610+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:43:16.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.626+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:43:16.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.626+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:43:16.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.654+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:43:16.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.666+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:16.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.682+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:43:16.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.682+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:43:16.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.694+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:43:16.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.702+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:43:16.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.702+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:43:16.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.734+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:16.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.734+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:43:16.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.734+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:16.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.742+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:43:16.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:43:16.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.786+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:43:16.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.786+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:16.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.802+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:16.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.814+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:16.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.818+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:16.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:43:16.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.838+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:43:16.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.838+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:16.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:16.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.866+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:16.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:43:16.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.878+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:43:16.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.906+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:43:16.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.938+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:43:16.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.958+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:16.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.962+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:16.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:16.970+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:17.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.006+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:17.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.018+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:17.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.026+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:43:17.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.042+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:17.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:43:17.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.046+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:43:17.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:43:17.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.062+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:43:17.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.078+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:43:17.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:43:17.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.102+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:43:17.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:43:17.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:43:17.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.126+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:43:17.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.142+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:17.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 91 16 1166473 1166457 801.064 810.125 0.00134903 0.00123646 2024-09-16T03:43:17.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:17.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.178+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:43:17.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.194+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:17.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.202+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:43:17.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.230+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:43:17.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.234+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:17.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.234+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:43:17.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.266+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:43:17.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.266+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:43:17.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.266+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:17.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.270+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:17.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.282+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:43:17.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.310+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:43:17.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.310+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:17.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.318+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:17.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:43:17.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.350+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:43:17.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.350+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:17.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.354+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:43:17.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.354+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:43:17.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.370+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:43:17.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.386+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:17.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.402+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:43:17.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.422+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:43:17.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:43:17.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.474+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:17.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.478+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:17.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.498+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:43:17.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.506+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:43:17.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:43:17.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.530+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:17.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.538+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:43:17.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.562+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:43:17.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.566+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:17.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.566+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:17.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.574+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:43:17.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.594+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:17.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.598+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:17.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.618+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:43:17.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.622+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:43:17.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.626+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:43:17.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.658+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:43:17.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.662+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:17.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.662+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:17.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.670+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:43:17.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.678+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:43:17.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.694+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:43:17.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.706+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:43:17.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.718+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:17.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.722+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:43:17.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.738+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:43:17.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.762+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:17.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.766+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:43:17.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.766+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:17.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.774+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:43:17.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.790+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:17.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.790+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:43:17.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.802+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:43:17.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.830+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:17.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.834+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:43:17.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.842+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:17.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.850+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:43:17.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.854+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:43:17.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.858+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:43:17.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.870+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:17.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.910+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:17.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.918+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:43:17.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.918+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:43:17.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.934+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:43:17.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.958+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:17.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:43:17.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.962+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:43:18.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.998+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:43:18.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:17.998+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:43:18.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.002+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:18.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:43:18.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.026+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:18.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.030+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:43:18.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.062+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:43:18.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.062+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:43:18.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.066+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:43:18.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.070+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:43:18.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.082+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:43:18.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.094+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:18.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.102+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:43:18.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.130+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:43:18.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.146+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:43:18.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 92 16 1179339 1179323 801.097 804.125 0.000733941 0.00123641 2024-09-16T03:43:18.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.162+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:43:18.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.162+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:43:18.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.170+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:43:18.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.174+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:43:18.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.186+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:43:18.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.194+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:18.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:43:18.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.222+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:43:18.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.230+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:18.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.242+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:43:18.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.242+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:43:18.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.250+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:43:18.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.262+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:18.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.270+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:43:18.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.286+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:43:18.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.294+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:43:18.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.306+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:43:18.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.318+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:43:18.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.322+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:43:18.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.326+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:43:18.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:43:18.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.342+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:43:18.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.354+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:43:18.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.378+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:43:18.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.386+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:43:18.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.394+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:18.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.398+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:43:18.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.410+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:43:18.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.414+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:43:18.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.426+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:18.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.434+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:43:18.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.450+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:18.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.478+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:43:18.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.490+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:18.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.498+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:18.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.510+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:43:18.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.518+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:43:18.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.526+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:43:18.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.526+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:43:18.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.534+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:43:18.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.542+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:18.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.550+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:43:18.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.566+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:43:18.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:18.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.582+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:43:18.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.586+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:43:18.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.594+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:43:18.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.606+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:43:18.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.606+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:43:18.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.626+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:18.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:43:18.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.646+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:18.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.646+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:43:18.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.650+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:43:18.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.674+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:18.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.682+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:43:18.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.686+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:43:18.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.698+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:43:18.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.702+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:18.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.710+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:43:18.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.734+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:43:18.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.738+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:18.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.758+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:43:18.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.766+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:43:18.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.786+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:18.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.786+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:18.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.790+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:18.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.794+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:43:18.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:43:18.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.830+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:18.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.846+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:18.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.858+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:18.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.858+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:18.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.870+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:43:18.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.882+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:18.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.882+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:43:18.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.886+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:18.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.910+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:43:18.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.922+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:43:18.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.930+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:43:18.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.938+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:18.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.942+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:18.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.946+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:43:18.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.950+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:43:18.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.958+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:43:18.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.970+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:43:18.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.986+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:43:18.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:18.990+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:19.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.010+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:19.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.042+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:43:19.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.058+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:19.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.062+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:43:19.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.062+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:43:19.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.074+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:43:19.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.078+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:19.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.102+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:43:19.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.106+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:19.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.110+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:43:19.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.110+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:43:19.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.122+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:43:19.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.130+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:43:19.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.138+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:19.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.150+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:43:19.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 93 16 1191620 1191604 800.735 767.562 0.00083219 0.00123696 2024-09-16T03:43:19.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.162+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:19.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:19.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.182+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:19.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.194+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:43:19.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.206+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:19.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.218+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:43:19.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.222+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:19.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.238+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:43:19.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.258+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:43:19.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.282+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:19.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.282+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:43:19.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.286+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:43:19.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.294+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:43:19.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.298+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:19.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.310+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:43:19.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.318+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:43:19.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.334+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:43:19.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.354+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:43:19.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.362+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:43:19.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:43:19.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.370+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:19.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:19.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.410+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:43:19.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.426+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:43:19.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.430+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:43:19.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.434+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:43:19.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.438+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:43:19.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.438+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:43:19.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.462+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:43:19.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.466+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:43:19.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.470+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:19.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.502+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:43:19.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:19.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.518+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:43:19.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:43:19.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.526+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:43:19.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.558+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:19.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.590+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:43:19.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.602+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:19.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.610+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:43:19.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.614+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:19.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.622+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:43:19.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.654+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:43:19.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.670+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:43:19.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.674+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:19.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.694+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:43:19.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.706+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:43:19.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:19.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.766+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:19.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.770+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:19.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.794+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:43:19.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.810+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:19.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.814+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:43:19.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.818+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:43:19.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.822+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:19.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:19.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.862+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:43:19.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.878+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:43:19.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.886+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:19.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:43:19.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.910+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:19.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.910+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:19.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.930+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:19.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.938+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:19.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:43:19.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.946+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:19.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.954+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:43:19.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:43:19.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.986+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:19.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:19.994+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:43:20.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.010+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:20.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.026+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:43:20.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.042+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:43:20.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.050+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:43:20.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.050+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:43:20.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.078+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:20.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.078+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:43:20.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.086+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:43:20.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:43:20.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.122+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:43:20.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.134+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:43:20.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:20.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.146+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:43:20.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.150+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:20.163 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 94 16 1204311 1204295 800.654 793.188 0.000898144 0.00123707 2024-09-16T03:43:20.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.162+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:43:20.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.178+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:43:20.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.202+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:43:20.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.202+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:20.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.210+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:20.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.226+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:43:20.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.230+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:43:20.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.234+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:43:20.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.242+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:20.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.258+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:43:20.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:43:20.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.278+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:43:20.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.294+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:20.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.298+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:43:20.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.298+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:43:20.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.298+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:43:20.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.310+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:20.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.318+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:20.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:43:20.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:43:20.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:43:20.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.378+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:20.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.390+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:20.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.394+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:43:20.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.414+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:20.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.414+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:43:20.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.422+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:43:20.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.434+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:43:20.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.434+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:43:20.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.514+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:20.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.514+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:43:20.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.530+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:43:20.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.550+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:20.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.554+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:20.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.554+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:43:20.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.566+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:43:20.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.578+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:43:20.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.610+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:20.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.618+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:20.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.630+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:43:20.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:43:20.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.662+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:20.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:43:20.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.678+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:43:20.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:43:20.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.694+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:43:20.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.702+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:43:20.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.742+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:43:20.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.750+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:43:20.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.754+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:20.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.754+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:43:20.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.758+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:20.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.770+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:20.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.778+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:20.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.782+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:43:20.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.782+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:43:20.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.818+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:43:20.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:20.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.830+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:20.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.858+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:43:20.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.874+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:43:20.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.882+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:43:20.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.902+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:43:20.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.914+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:20.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.922+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:43:20.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.934+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:20.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.950+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:20.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.950+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:43:20.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.954+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:43:20.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.982+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:20.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.982+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:43:20.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.986+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:21.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:20.998+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:43:21.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.010+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:43:21.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.030+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:21.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.034+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:43:21.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.042+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:21.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.054+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:21.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.070+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:43:21.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:43:21.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.086+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:43:21.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.102+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:43:21.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.114+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:21.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.134+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:43:21.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 95 16 1217279 1217263 800.757 810.5 0.00122113 0.00123696 2024-09-16T03:43:21.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.166+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:43:21.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.182+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:21.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.190+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:43:21.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.202+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:21.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.222+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:43:21.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.254+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:21.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.258+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:21.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.278+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:43:21.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.290+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:43:21.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.294+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:43:21.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.306+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:43:21.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.318+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:21.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:43:21.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.334+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:43:21.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:21.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.370+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:43:21.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.378+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:43:21.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.378+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:21.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.382+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:43:21.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.398+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:21.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.410+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:21.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.426+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:43:21.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.430+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:43:21.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.442+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:43:21.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.462+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:43:21.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.466+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:43:21.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.478+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:43:21.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.494+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:43:21.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:43:21.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:43:21.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.518+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:21.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.522+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:21.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:43:21.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:43:21.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.590+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:43:21.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.598+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:43:21.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.598+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:21.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.614+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:21.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.630+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:21.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:21.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.658+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:43:21.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.682+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:43:21.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.690+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:21.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.702+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:43:21.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.718+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:21.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.730+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:43:21.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.770+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:21.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:43:21.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.782+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:43:21.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.790+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:43:21.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.798+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:43:21.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.810+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:21.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.830+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:21.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.842+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:21.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.842+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:21.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.854+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:43:21.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.854+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:43:21.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:43:21.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.894+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:21.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.902+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:21.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.922+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:43:21.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.926+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:43:21.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.930+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:21.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.950+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:21.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.954+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:43:21.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.966+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:43:21.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:43:21.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:21.978+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:43:22.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.018+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:43:22.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.034+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:43:22.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.038+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:43:22.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.046+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:43:22.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.046+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:22.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.050+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:43:22.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.074+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:43:22.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.086+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:43:22.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.098+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:22.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.098+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:43:22.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.102+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:43:22.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.138+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:43:22.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 96 16 1230868 1230852 801.26 849.312 0.00114821 0.00123616 2024-09-16T03:43:22.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.178+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:43:22.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.190+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:22.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.190+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:43:22.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.194+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:22.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.198+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:43:22.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.218+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:43:22.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.222+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:43:22.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.230+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:22.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.242+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:43:22.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.250+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:22.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.254+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:22.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.262+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:43:22.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.270+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:43:22.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.290+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:43:22.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.298+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:22.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.306+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:43:22.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.306+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:43:22.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.334+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:43:22.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.346+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:43:22.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:22.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.382+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:43:22.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:22.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.394+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:43:22.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.402+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:43:22.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.414+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:43:22.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.422+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:43:22.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.422+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:22.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.434+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:43:22.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.438+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:43:22.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.446+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:22.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.446+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:43:22.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.498+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:43:22.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.502+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:22.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.510+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:43:22.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.514+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:43:22.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.522+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:43:22.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.550+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:22.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.558+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:43:22.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.562+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:43:22.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.562+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:43:22.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.574+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:22.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.586+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:22.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.594+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:43:22.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.606+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:43:22.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.626+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:22.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.658+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:43:22.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.658+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:22.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.674+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:43:22.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.686+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:22.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.690+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:22.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.714+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:43:22.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.726+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:22.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.738+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:22.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:43:22.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.746+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:22.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.754+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:43:22.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.762+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:43:22.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:43:22.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.794+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:43:22.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.814+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:43:22.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.818+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:22.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.834+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:43:22.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.846+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:43:22.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.846+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:43:22.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.870+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:43:22.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.890+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:43:22.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.906+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:22.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.930+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:43:22.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.930+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:22.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.934+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:22.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.938+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:22.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.958+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:43:22.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.962+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:43:22.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:22.982+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:23.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:23.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.014+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:23.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.022+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:23.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:43:23.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:43:23.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.098+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:43:23.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.102+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:23.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.102+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:23.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.106+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:43:23.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.134+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:43:23.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.138+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:43:23.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.146+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:23.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 97 16 1243864 1243848 801.372 812.25 0.00079093 0.00123598 2024-09-16T03:43:23.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:43:23.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.166+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:43:23.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.174+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:43:23.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.190+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:23.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:43:23.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.202+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:43:23.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.206+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:23.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.222+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:23.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.238+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:23.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.242+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:23.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.254+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:23.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.258+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:43:23.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.278+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:43:23.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.290+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:43:23.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.294+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:43:23.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.302+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:23.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.326+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:23.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.326+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:23.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:43:23.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.354+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:43:23.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:23.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.378+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:43:23.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.382+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:43:23.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.398+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:23.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:43:23.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.426+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:23.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.430+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:23.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:43:23.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.446+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:23.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.458+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:43:23.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.474+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:23.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.482+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:43:23.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.486+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:23.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.510+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:43:23.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.514+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:43:23.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.538+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:43:23.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.538+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:23.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.562+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:43:23.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.582+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:23.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.602+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:43:23.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.606+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:43:23.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.618+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:43:23.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:43:23.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.638+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:23.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.638+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:43:23.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.670+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:23.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.690+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:23.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.714+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:43:23.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.714+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:23.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.722+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:43:23.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.730+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:23.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:23.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.810+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:43:23.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.818+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:23.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.822+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:23.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.826+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:23.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.834+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:43:23.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.846+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:23.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.850+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:43:23.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.866+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:43:23.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.874+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:23.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:23.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.913+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:43:23.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.913+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:43:23.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:43:23.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.941+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:43:23.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.949+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:23.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.957+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:43:23.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.973+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:23.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:43:24.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:23.997+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:43:24.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:43:24.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.013+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:43:24.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.017+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:43:24.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:43:24.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.061+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:43:24.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.065+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:43:24.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.073+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:43:24.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.081+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:24.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.089+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:43:24.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:24.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:24.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.117+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:43:24.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.133+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:24.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.145+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:24.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.149+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:43:24.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:43:24.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 98 16 1256577 1256561 801.302 794.562 0.00266251 0.00123606 2024-09-16T03:43:24.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:24.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:43:24.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.185+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:43:24.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:24.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:24.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.217+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:43:24.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.233+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:43:24.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.273+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:24.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.273+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:43:24.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.277+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:43:24.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.289+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:24.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.293+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:43:24.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.293+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:43:24.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.305+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:43:24.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:43:24.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.329+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:43:24.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:43:24.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.369+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:24.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.409+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:43:24.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:24.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.433+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:24.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:43:24.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:43:24.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.509+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:43:24.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.513+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:43:24.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:43:24.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.541+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:24.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.549+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:24.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:43:24.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.565+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:43:24.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:24.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:43:24.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.601+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:24.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.605+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:24.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:24.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.617+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:43:24.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.629+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:43:24.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.629+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:43:24.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.661+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:24.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.721+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:43:24.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.733+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:43:24.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.749+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:43:24.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:43:24.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.789+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:43:24.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.793+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:24.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.801+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:43:24.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.801+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:43:24.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.813+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:43:24.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.821+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:43:24.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.825+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:43:24.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.829+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:24.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:43:24.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:43:24.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.873+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:43:24.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.889+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:24.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.905+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:43:24.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.909+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:43:24.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.925+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:24.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.973+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:43:24.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.973+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:24.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:24.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:25.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.005+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:43:25.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.029+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:43:25.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.061+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:43:25.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.077+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:43:25.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.085+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:43:25.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.097+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:43:25.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.113+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:43:25.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.137+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:25.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.137+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:43:25.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:43:25.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 99 16 1269914 1269898 801.627 833.562 0.000977713 0.00123559 2024-09-16T03:43:25.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.161+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:43:25.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:43:25.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.169+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:43:25.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.197+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:43:25.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.209+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:43:25.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.213+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:43:25.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.217+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:43:25.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.225+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:25.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.245+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:43:25.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.249+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:25.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:43:25.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.265+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:25.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.269+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:43:25.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.305+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:43:25.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:25.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.329+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:43:25.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.345+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:43:25.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.365+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:43:25.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.365+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:43:25.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.381+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:43:25.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.393+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:43:25.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.393+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:25.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.401+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:43:25.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.429+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:43:25.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.437+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:43:25.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.449+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:25.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.449+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:25.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.477+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:43:25.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.485+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:43:25.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.493+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:43:25.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:43:25.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:25.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:25.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.513+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:43:25.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.537+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:25.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:43:25.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.581+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:25.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.585+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:43:25.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.589+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:25.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:25.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:25.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.649+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:43:25.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:25.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.665+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:25.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.681+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:43:25.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.685+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:25.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.689+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:43:25.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.705+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:43:25.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:43:25.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.753+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:25.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.753+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:43:25.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.769+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:25.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:43:25.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.793+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:25.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.813+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:43:25.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.813+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:25.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.817+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:25.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:43:25.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.833+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:43:25.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:43:25.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.853+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:43:25.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.869+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:25.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:25.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.889+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:25.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:25.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.905+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:25.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.921+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:43:25.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:43:25.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.953+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:43:25.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.953+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:43:26.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:25.997+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:43:26.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.001+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:26.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.021+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:43:26.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.033+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:43:26.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.041+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:43:26.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.041+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:43:26.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.053+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:26.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:43:26.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:43:26.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:43:26.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:43:26.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.109+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:43:26.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.121+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:43:26.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.129+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:26.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.133+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:43:26.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:43:26.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:43:26.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:43:26.163827+0000 min lat: 0.000239237 max lat: 0.129137 avg lat: 0.00123516 2024-09-16T03:43:26.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:43:26.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 100 15 1283182 1283167 801.904 829.312 0.000716737 0.00123516 2024-09-16T03:43:26.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.177+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:26.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.177+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:43:26.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.181+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:43:26.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.181+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:26.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:43:26.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.221+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:26.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.229+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:43:26.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.237+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:43:26.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.261+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:43:26.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.265+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:43:26.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.265+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:43:26.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.273+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:43:26.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.293+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:26.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.305+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:26.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.309+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:26.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:43:26.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.321+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:26.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.337+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:26.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:43:26.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.365+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:43:26.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.365+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:43:26.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.373+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:43:26.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.377+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:43:26.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.397+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:26.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.417+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:26.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.425+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:26.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.441+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:26.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.457+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:26.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.473+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:26.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.481+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:43:26.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.501+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:43:26.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.505+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:43:26.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:43:26.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:43:26.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:43:26.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.565+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:26.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.577+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:43:26.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.585+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:26.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.593+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:43:26.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.597+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:26.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.613+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:43:26.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.621+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:43:26.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.641+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:43:26.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.641+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:43:26.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:26.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:26.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.685+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:43:26.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.693+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:43:26.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.713+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:43:26.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:43:26.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.729+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:26.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.741+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:26.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:43:26.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:43:26.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.785+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:43:26.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:43:26.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.813+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:43:26.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.821+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:26.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.829+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:43:26.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.853+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:26.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.857+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:43:26.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.861+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:43:26.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.873+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:43:26.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.885+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:43:26.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:26.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:43:26.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.913+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:43:26.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.921+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:26.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.949+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:26.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.957+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:26.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.989+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:26.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:26.989+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:27.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.001+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:27.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:27.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.009+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:27.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.013+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:43:27.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.033+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:43:27.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:43:27.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:43:27.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.069+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:27.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:43:27.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.085+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:43:27.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.085+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:27.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.141+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:27.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 101 16 1296484 1296468 802.194 831.312 0.000784984 0.00123472 2024-09-16T03:43:27.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.161+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:43:27.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.173+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:43:27.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.189+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:27.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.201+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:43:27.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:43:27.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.233+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:43:27.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.237+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:43:27.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.241+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:43:27.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.253+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:43:27.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.277+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:27.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:43:27.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.289+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:43:27.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.297+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:43:27.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.309+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:43:27.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.317+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:43:27.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:27.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:43:27.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.325+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:27.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:27.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.381+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:27.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:27.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.397+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:43:27.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.401+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:43:27.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:43:27.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.437+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:27.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.441+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:43:27.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.449+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:43:27.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:27.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.497+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:27.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.501+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:43:27.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:27.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.517+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:27.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.517+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:43:27.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.525+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:43:27.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:43:27.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:27.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.569+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:43:27.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.581+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:27.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:27.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.589+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:43:27.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:43:27.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.633+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:43:27.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.653+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:43:27.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:43:27.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.657+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:43:27.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.681+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:43:27.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.685+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:43:27.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:43:27.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:43:27.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.717+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:27.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.721+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:43:27.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.729+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:43:27.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.749+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:43:27.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.773+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:43:27.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:43:27.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.781+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:27.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:43:27.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.797+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:43:27.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.829+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:43:27.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:27.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.845+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:43:27.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.849+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:43:27.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.873+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:27.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:43:27.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.901+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:43:27.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.917+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:43:27.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:27.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:43:27.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.933+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:43:27.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.933+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:27.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.969+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:27.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.973+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:27.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.981+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:43:27.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:27.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:43:28.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.013+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:43:28.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.013+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:43:28.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.033+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:43:28.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:43:28.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.045+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:28.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:43:28.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.081+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:43:28.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:43:28.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.105+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:43:28.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.117+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:43:28.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.121+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:43:28.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.125+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:43:28.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.129+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:28.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.137+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:43:28.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.153+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:43:28.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 102 15 1309467 1309452 802.285 811.5 0.00110953 0.00123455 2024-09-16T03:43:28.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:43:28.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.165+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:28.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.189+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:28.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:28.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.209+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:43:28.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.221+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:43:28.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:43:28.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:43:28.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.257+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:43:28.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:28.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:43:28.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.297+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:43:28.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.297+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:43:28.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.309+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:28.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.309+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:43:28.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.329+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:43:28.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.337+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:43:28.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.357+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:43:28.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:28.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.365+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:28.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.385+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:28.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.385+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:43:28.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.397+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:28.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.417+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:28.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.433+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:43:28.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.445+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:43:28.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:28.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.477+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:43:28.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:28.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:28.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.509+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:43:28.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:43:28.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.517+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:28.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.525+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:43:28.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:28.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:28.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.549+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:43:28.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.565+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:43:28.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.573+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:28.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.581+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:28.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.585+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:43:28.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.589+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:43:28.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.613+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:43:28.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.637+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:43:28.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.641+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:43:28.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.641+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:28.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.677+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:43:28.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:28.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.705+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:28.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.717+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:28.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.721+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:43:28.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.737+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:28.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.745+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:43:28.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.753+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:43:28.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.765+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:28.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.809+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:43:28.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.813+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:43:28.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.817+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:28.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:28.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:28.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.861+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:43:28.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.869+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:43:28.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.877+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:28.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.897+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:43:28.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.897+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:28.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.901+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:28.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.913+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:43:28.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.921+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:43:28.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.937+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:28.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.945+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:28.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:43:28.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:28.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:43:29.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:28.997+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:29.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:43:29.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:29.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:43:29.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:29.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.065+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:43:29.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.073+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:43:29.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:43:29.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.101+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:43:29.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.109+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:43:29.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.133+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:43:29.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.141+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:29.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.145+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:43:29.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.149+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:43:29.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.157+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:43:29.164 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 103 16 1322228 1322212 802.237 797.5 0.00277673 0.00123462 2024-09-16T03:43:29.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.169+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:29.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.169+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:29.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:29.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.209+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:29.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.225+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:43:29.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.233+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:43:29.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.237+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:43:29.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.241+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:43:29.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.253+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:43:29.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:29.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:29.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.305+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:43:29.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.321+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:29.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.329+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:29.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:43:29.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.349+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:29.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.361+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:43:29.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.373+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:29.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:43:29.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.429+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:29.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.433+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:43:29.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.457+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:29.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.469+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:29.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:29.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.481+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:43:29.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.493+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:29.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:43:29.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:43:29.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.505+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:43:29.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:29.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.541+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:43:29.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.541+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:43:29.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:29.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.601+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:43:29.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:29.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:43:29.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.633+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:29.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.637+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:43:29.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:43:29.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:43:29.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.705+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:43:29.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.717+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:43:29.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.733+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:43:29.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:29.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.761+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:43:29.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.765+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:29.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.781+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:43:29.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.785+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:43:29.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.817+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:43:29.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.825+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:43:29.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.829+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:43:29.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.837+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:29.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:43:29.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.861+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:43:29.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.881+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:29.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.889+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:43:29.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.901+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:29.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.913+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:43:29.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.921+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:43:29.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.941+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:43:29.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.941+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:29.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.957+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:43:29.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.969+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:43:29.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:29.985+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:43:30.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.001+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:30.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.005+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:30.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.005+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:30.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.025+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:30.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.029+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:30.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:43:30.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:30.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.101+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:30.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.105+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:43:30.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:43:30.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.121+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:43:30.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.145+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:30.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:43:30.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 104 16 1335355 1335339 802.411 820.438 0.000547572 0.00123437 2024-09-16T03:43:30.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.161+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:43:30.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:43:30.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.165+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:30.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.169+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:43:30.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.189+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:43:30.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.217+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:43:30.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.221+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:30.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:30.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.253+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:43:30.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.265+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:43:30.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.265+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:43:30.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.297+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:30.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.325+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:30.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:43:30.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.337+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:43:30.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.353+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:43:30.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.365+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:43:30.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:30.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.381+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:43:30.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.401+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:30.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.405+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:43:30.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.405+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:43:30.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.445+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:30.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.445+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:43:30.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.453+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:43:30.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.469+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:43:30.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.481+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:43:30.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.485+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:43:30.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:43:30.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.505+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:43:30.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.521+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:43:30.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.529+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:30.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.529+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:43:30.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.541+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:43:30.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.553+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:30.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.561+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:43:30.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.573+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:43:30.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:43:30.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.589+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:30.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:30.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:43:30.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.621+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:43:30.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.633+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:43:30.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:43:30.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:43:30.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.669+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:43:30.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.669+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:43:30.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:43:30.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.693+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:43:30.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:30.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.713+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:30.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:43:30.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:43:30.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.749+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:43:30.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.765+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:43:30.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:30.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.797+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:43:30.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.817+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:43:30.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.821+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:30.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.841+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:30.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.841+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:43:30.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.857+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:43:30.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:43:30.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:43:30.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.893+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:30.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.909+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:30.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:43:30.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.921+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:43:30.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.933+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:43:30.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.933+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:30.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.941+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:30.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:30.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:30.985+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:31.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.001+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:31.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.009+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:31.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.009+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:31.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.013+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:31.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.017+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:43:31.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:43:31.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.053+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:31.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:43:31.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.057+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:43:31.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:43:31.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.085+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:43:31.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.097+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:43:31.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.101+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:31.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.109+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:43:31.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.117+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:43:31.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.145+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:43:31.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 105 15 1348180 1348165 802.403 801.625 0.000605468 0.00123439 2024-09-16T03:43:31.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.177+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:43:31.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:43:31.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.193+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:43:31.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:31.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.205+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:43:31.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:43:31.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:31.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:43:31.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.253+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:43:31.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:43:31.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.281+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:31.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.313+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:43:31.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.321+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:31.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.361+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:43:31.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.369+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:43:31.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:43:31.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.389+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:43:31.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:43:31.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.397+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:31.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.417+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:31.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.429+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:43:31.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.437+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:43:31.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.437+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:43:31.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.469+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:43:31.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.469+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:31.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.473+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:31.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.477+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:43:31.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:43:31.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.505+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:31.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.509+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:31.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.529+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:43:31.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:43:31.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:43:31.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.549+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:31.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.561+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:31.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.561+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:43:31.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.569+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:31.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:43:31.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.581+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:43:31.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.609+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:43:31.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.609+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:31.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:43:31.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.633+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:43:31.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.637+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:31.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.657+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:43:31.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:31.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.673+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:31.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.685+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:43:31.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.697+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:43:31.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.725+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:43:31.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.725+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:43:31.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:31.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.745+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:43:31.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:43:31.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.801+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:43:31.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:31.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.825+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:31.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.845+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:31.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:31.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:43:31.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:43:31.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.885+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:43:31.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:43:31.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:31.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:31.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.917+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:31.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.929+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:43:31.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:43:31.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.945+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:31.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.973+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:43:31.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.977+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:43:31.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:31.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:31.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:43:32.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.017+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:43:32.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.021+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:43:32.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.041+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:32.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:43:32.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.049+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:43:32.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.057+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:43:32.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.061+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:32.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.093+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:32.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.093+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:32.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:43:32.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:43:32.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.117+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:43:32.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.141+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:32.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.145+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:32.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.149+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:32.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:43:32.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.157+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:43:32.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 106 16 1361084 1361068 802.44 806.438 0.0033656 0.00123431 2024-09-16T03:43:32.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.169+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:43:32.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:43:32.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:43:32.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.241+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:43:32.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:43:32.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:43:32.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:32.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:43:32.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.281+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:43:32.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.281+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:32.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.313+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:32.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:32.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.321+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:32.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.357+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:32.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.365+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:43:32.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.365+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:43:32.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.377+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:32.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:43:32.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.409+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:43:32.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.449+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:43:32.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.457+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:43:32.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:43:32.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.477+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:43:32.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:43:32.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.529+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:43:32.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.529+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:43:32.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.545+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:32.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:32.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.569+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:43:32.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.577+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:43:32.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.589+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:43:32.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:43:32.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.625+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:43:32.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.649+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:43:32.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:32.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.673+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:43:32.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.673+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:43:32.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.677+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:43:32.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:43:32.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.721+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:32.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.725+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:43:32.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.733+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:43:32.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.741+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:32.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.765+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:32.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:43:32.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.785+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:32.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.789+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:32.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.809+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:43:32.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:32.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.845+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:32.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.857+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:43:32.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.861+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:43:32.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.865+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:43:32.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:43:32.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:43:32.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.917+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:43:32.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.933+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:32.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.961+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:43:32.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.969+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:32.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.981+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:32.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.993+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:43:33.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:32.997+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:43:33.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:43:33.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.037+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:43:33.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.041+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:43:33.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.057+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:33.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.077+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:33.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:33.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:33.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:33.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:33.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:43:33.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.145+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:33.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:33.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.149+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:43:33.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 107 16 1374547 1374531 802.804 841.438 0.000918819 0.00123374 2024-09-16T03:43:33.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:33.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.169+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:33.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:43:33.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:43:33.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.249+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:33.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.253+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:43:33.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.285+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:43:33.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.293+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:33.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:43:33.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.321+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:43:33.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.325+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:33.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:43:33.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:43:33.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.365+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:43:33.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.373+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:43:33.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.381+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:43:33.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.385+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:33.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:43:33.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.405+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:33.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.413+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:33.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.429+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:43:33.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.441+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:43:33.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.445+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:33.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.453+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:33.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:43:33.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.477+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:33.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.481+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:43:33.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:43:33.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.497+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:43:33.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.513+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:43:33.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:43:33.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.529+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:43:33.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.541+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:43:33.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.589+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:43:33.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.609+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:33.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:43:33.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.621+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:43:33.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.633+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:43:33.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:43:33.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:33.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.685+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:43:33.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:43:33.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.697+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:43:33.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.697+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:43:33.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:33.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.745+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:43:33.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.753+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:43:33.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.769+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:43:33.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.769+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:43:33.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:43:33.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.785+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:43:33.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.789+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:43:33.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.821+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:43:33.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:43:33.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:43:33.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.845+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:43:33.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:43:33.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.861+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:43:33.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.889+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:43:33.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:33.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.909+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:43:33.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.917+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:43:33.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.945+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:33.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:33.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.961+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:33.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.969+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:43:33.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:43:33.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:43:33.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:33.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:43:34.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.009+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:43:34.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.025+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:43:34.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.029+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:43:34.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.041+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:43:34.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:34.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.057+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:43:34.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.081+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:43:34.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.089+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:43:34.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:34.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:43:34.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.129+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:34.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:43:34.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:43:34.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 108 15 1387513 1387498 802.874 810.438 0.000914224 0.00123365 2024-09-16T03:43:34.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:34.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:43:34.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:34.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.185+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:43:34.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:43:34.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:34.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.217+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:43:34.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.225+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:43:34.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.245+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:43:34.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:43:34.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.281+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:34.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.289+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:34.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.301+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:34.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.305+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:43:34.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.305+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:43:34.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.337+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:43:34.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.341+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:43:34.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.345+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:34.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.349+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:43:34.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.373+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:43:34.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.377+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:43:34.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.393+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:43:34.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.401+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:43:34.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.405+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:43:34.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.417+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:34.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.429+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:43:34.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.453+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:34.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.481+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:43:34.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.489+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:43:34.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.497+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:34.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.517+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:43:34.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:43:34.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.521+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:43:34.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.533+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:43:34.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.561+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:43:34.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.561+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:43:34.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.569+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:43:34.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.585+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:34.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:34.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:43:34.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.613+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:34.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.621+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:43:34.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:34.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.633+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:43:34.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:43:34.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:43:34.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:43:34.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.721+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:43:34.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.721+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:43:34.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.729+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:43:34.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.773+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:43:34.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:34.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.773+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:43:34.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:43:34.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.829+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:43:34.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.833+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:34.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.869+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:34.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.877+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:34.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.901+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:43:34.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.905+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:43:34.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:34.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.921+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:34.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.933+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:43:34.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:34.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.945+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:43:34.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.953+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:43:34.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.957+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:43:34.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.961+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:43:34.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:34.993+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:43:35.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.001+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:43:35.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.013+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:43:35.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:35.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:43:35.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.053+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:43:35.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.061+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:43:35.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.077+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:43:35.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.085+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:35.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:43:35.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.097+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:43:35.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:43:35.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.133+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:43:35.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:35.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 109 15 1400721 1400706 803.081 825.5 0.000730266 0.00123334 2024-09-16T03:43:35.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.173+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:43:35.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:43:35.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:43:35.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:43:35.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.209+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:43:35.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:35.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:43:35.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.249+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.261+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.285+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.285+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.305+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.321+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.357+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:43:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.365+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:43:35.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.373+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:43:35.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.377+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:43:35.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.377+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:43:35.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.389+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:35.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.401+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:43:35.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:43:35.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.421+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:43:35.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.429+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:35.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.449+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:43:35.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:35.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:43:35.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.485+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:43:35.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.485+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:43:35.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.489+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:43:35.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.513+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:43:35.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.537+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:43:35.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:35.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.549+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:43:35.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:35.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.597+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:43:35.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:35.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.605+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:43:35.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:43:35.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.629+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:43:35.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.657+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:43:35.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:35.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.673+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:43:35.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.685+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:43:35.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.693+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:43:35.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:43:35.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:43:35.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.745+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:43:35.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.757+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:43:35.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.757+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:35.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.793+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:43:35.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.801+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:43:35.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:35.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:35.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.877+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:43:35.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.885+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:43:35.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.885+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:43:35.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:43:35.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.905+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:35.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.929+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:43:35.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.941+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:43:35.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:43:35.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:43:35.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:35.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:43:36.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.017+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:43:36.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.025+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:43:36.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.029+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:43:36.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.041+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:43:36.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:43:36.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:43:36.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.077+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:43:36.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.085+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:43:36.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.109+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:43:36.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.113+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:36.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.125+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:43:36.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.133+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:43:36.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.141+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:36.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 110 15 1414161 1414146 803.416 840 0.0012782 0.00123281 2024-09-16T03:43:36.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.165+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:43:36.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.169+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:43:36.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:36.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:36.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.197+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:43:36.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.197+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:43:36.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.225+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:43:36.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.225+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:43:36.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.229+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:43:36.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:43:36.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.261+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:36.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.273+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:36.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.285+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:43:36.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.297+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:43:36.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.301+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:36.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.301+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:36.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:36.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.333+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:36.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.341+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:43:36.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.373+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:43:36.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:36.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:43:36.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.397+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:43:36.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:36.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.397+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:43:36.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.417+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:36.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.425+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:43:36.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.457+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:43:36.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:43:36.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.505+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:43:36.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:36.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.537+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:43:36.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:43:36.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.561+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:43:36.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.581+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:36.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.585+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:43:36.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:36.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:36.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.645+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:43:36.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.661+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:43:36.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.665+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:43:36.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.681+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:43:36.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.689+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:36.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:43:36.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.705+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:43:36.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.709+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:36.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.713+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:43:36.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:36.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:36.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.753+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:43:36.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:43:36.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.761+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:36.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:43:36.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:43:36.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.821+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:36.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.829+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:36.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.837+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:43:36.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:43:36.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:43:36.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.857+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:43:36.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.893+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:43:36.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.901+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:43:36.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:36.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.921+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:36.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.949+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:43:36.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.953+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:43:36.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:43:36.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:43:37.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:36.997+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:43:37.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.001+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:37.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.021+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:37.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:43:37.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:43:37.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.045+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:37.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.069+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:43:37.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.081+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:37.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:43:37.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.101+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:43:37.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.121+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:43:37.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.133+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:37.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.141+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:43:37.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:43:37.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.157+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:43:37.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.161+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:37.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 111 15 1427538 1427523 803.71 836.062 0.00120557 0.00123235 2024-09-16T03:43:37.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:43:37.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.165+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:43:37.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:43:37.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.185+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:37.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:43:37.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:43:37.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.209+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:37.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.229+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:43:37.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.245+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:43:37.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.253+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:43:37.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:43:37.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.281+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:37.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:43:37.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:43:37.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.329+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:43:37.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.341+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:43:37.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.345+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:43:37.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:43:37.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.365+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:43:37.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.381+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:37.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.385+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:37.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:37.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:43:37.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.417+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:37.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.449+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:43:37.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:37.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.461+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:43:37.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.481+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:43:37.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.485+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:43:37.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.489+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:43:37.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.509+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:43:37.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.517+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:37.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:43:37.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.537+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:43:37.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.549+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:43:37.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:43:37.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:43:37.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.589+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:43:37.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.601+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:43:37.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:37.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.605+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:43:37.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.617+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:37.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:37.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.629+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:37.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:43:37.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.657+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:43:37.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:43:37.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.685+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:43:37.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.689+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:43:37.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:43:37.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:37.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.717+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:43:37.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.733+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:43:37.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:37.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.773+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:37.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.789+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:43:37.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.789+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:43:37.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.797+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:43:37.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.797+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:43:37.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.829+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:43:37.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.829+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:43:37.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.841+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:37.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:37.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:37.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.869+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:37.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:43:37.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:37.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.893+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:43:37.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.897+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:37.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:43:37.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.913+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:43:37.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.929+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:37.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.933+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:43:37.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.953+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:43:37.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:43:37.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:43:37.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.977+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:43:37.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:43:38.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:37.997+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:43:38.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:43:38.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.009+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:38.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.033+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:43:38.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.041+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:38.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.053+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:38.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.061+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:43:38.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.069+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:43:38.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:43:38.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.089+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:43:38.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.093+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:38.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:43:38.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.109+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:38.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:43:38.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.141+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:38.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 112 15 1440161 1440146 803.577 788.938 0.000712477 0.00123257 2024-09-16T03:43:38.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:38.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.165+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:43:38.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:43:38.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.193+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:38.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.193+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:43:38.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:38.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:38.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:43:38.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.225+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:43:38.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.237+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:38.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.237+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:43:38.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.245+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:43:38.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.253+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:38.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.281+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:43:38.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.285+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:43:38.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.297+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:43:38.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.297+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:43:38.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.309+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:43:38.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:43:38.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.325+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:38.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.333+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:43:38.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:43:38.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.353+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:43:38.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.361+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:38.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.361+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:43:38.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.369+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:43:38.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:43:38.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.409+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:43:38.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.449+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:38.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.453+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:38.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:38.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.481+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:43:38.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.485+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:38.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.485+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:43:38.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.493+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:38.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.521+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:43:38.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.525+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:38.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:43:38.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.537+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:43:38.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.557+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:38.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:43:38.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.569+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:38.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:43:38.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:43:38.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.601+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:43:38.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:43:38.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.625+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:43:38.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.625+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:38.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.637+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:43:38.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.649+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:43:38.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.653+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:38.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.661+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:38.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.661+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:43:38.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:43:38.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.709+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:43:38.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.725+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:43:38.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.729+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:43:38.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:43:38.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.737+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:43:38.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.761+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:43:38.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.761+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:43:38.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:38.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.793+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:43:38.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.793+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:38.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.801+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:43:38.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.841+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:43:38.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:38.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.869+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:43:38.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.873+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:43:38.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.889+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:43:38.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:43:38.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:43:38.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.949+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:43:38.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:43:38.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:43:38.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.965+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:43:38.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:38.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:39.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.005+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:43:39.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.005+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:43:39.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.017+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:43:39.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.025+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:43:39.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:43:39.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:39.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.037+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:39.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.049+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:43:39.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.057+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:43:39.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.089+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:43:39.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.093+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:39.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:39.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:43:39.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.141+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:43:39.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.153+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:43:39.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:39.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 113 15 1453115 1453100 803.63 809.625 0.000738189 0.00123248 2024-09-16T03:43:39.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.169+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:43:39.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:39.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.189+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:43:39.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.189+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:43:39.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:43:39.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:43:39.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.229+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:43:39.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.237+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:43:39.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.249+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:39.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.265+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:43:39.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.277+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:43:39.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.289+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:43:39.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.305+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:39.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.309+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:43:39.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.313+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:43:39.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.321+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:43:39.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.329+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:43:39.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.353+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:39.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.357+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:39.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.365+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:43:39.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.381+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:43:39.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.389+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:43:39.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.421+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:43:39.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.429+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:39.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:43:39.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:39.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.453+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:39.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:39.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.477+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:43:39.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.497+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:43:39.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.509+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:43:39.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:39.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.517+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:39.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.529+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:43:39.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.529+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:39.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.541+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:43:39.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:39.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.581+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:43:39.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:43:39.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:43:39.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:39.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.621+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:43:39.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:43:39.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:39.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:43:39.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.777+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:43:39.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.785+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:43:39.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.813+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:43:39.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.813+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:43:39.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:43:39.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.841+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:39.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.853+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:43:39.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.861+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:43:39.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.885+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:39.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.889+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:39.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.909+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:43:39.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.913+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:43:39.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.921+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:39.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.933+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:43:39.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.941+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:39.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.953+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:43:39.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:43:39.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.961+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:39.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:43:40.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:39.997+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:43:40.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:43:40.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.013+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:40.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.041+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:40.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.041+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:43:40.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:43:40.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.073+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:43:40.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.077+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:40.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:40.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 114 16 1463405 1463389 802.221 643.062 0.00128227 0.0012346 2024-09-16T03:43:40.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.173+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:43:40.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.201+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:43:40.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:43:40.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.225+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:40.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.233+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:40.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.233+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:43:40.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.265+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:43:40.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.269+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:43:40.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:43:40.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:43:40.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.305+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:40.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.309+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:40.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.321+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:43:40.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.345+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:43:40.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:43:40.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:43:40.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.361+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:43:40.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.389+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:43:40.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.393+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:43:40.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.401+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:43:40.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.429+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:43:40.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.433+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:43:40.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.453+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:43:40.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.453+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:40.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:40.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.461+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:40.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:43:40.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.517+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:43:40.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.521+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:40.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:40.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.553+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:43:40.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.609+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:43:40.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.613+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:40.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.629+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:43:40.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:43:40.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.641+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:40.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:40.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:40.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.669+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:43:40.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.681+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:40.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.689+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:40.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.701+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:43:40.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.705+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:40.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.717+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:43:40.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:43:40.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.741+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:43:40.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.749+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:43:40.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.753+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:40.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:40.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.761+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:43:40.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.765+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:43:40.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.789+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:43:40.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:43:40.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.817+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:43:40.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.833+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:40.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.841+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:43:40.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.849+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:40.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:43:40.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:43:40.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.869+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:43:40.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.897+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:43:40.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.917+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:43:40.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.917+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:40.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.929+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:40.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.945+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:43:40.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.957+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:43:40.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.977+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:43:40.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:40.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.985+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:43:41.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:40.997+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:43:41.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.025+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:41.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.041+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:43:41.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:43:41.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.049+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:43:41.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.053+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:41.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.061+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:43:41.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.093+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:43:41.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.105+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:43:41.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.125+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:41.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:43:41.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.129+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:41.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.157+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:41.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 115 16 1476291 1476275 802.248 805.375 0.00125868 0.00123462 2024-09-16T03:43:41.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.173+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:43:41.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:41.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.181+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:43:41.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.197+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:43:41.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.201+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:43:41.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.209+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:41.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.221+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:43:41.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.253+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:43:41.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.253+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:41.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:41.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:43:41.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:41.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.301+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:41.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.301+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:43:41.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:43:41.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.353+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:41.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.361+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:41.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.373+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:43:41.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.381+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:41.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.389+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:41.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.409+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:43:41.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.417+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:43:41.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.425+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:43:41.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:43:41.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:43:41.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:43:41.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:43:41.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:43:41.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:43:41.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.501+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:41.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.517+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:41.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:43:41.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:43:41.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:43:41.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:43:41.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:43:41.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.569+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:43:41.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.581+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:43:41.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.581+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:43:41.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:41.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.597+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:43:41.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:41.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.617+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:43:41.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.617+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:41.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.621+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:43:41.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.637+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:43:41.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:43:41.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:41.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.689+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:43:41.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.709+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:41.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:43:41.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:43:41.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.717+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:43:41.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.729+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:41.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.741+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:41.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:43:41.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.757+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:43:41.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.757+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:43:41.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:41.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:43:41.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.829+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:43:41.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.849+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:41.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.865+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:41.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:41.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:43:41.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.905+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:41.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.909+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:41.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.913+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:43:41.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:43:41.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:43:41.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.933+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:43:41.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.965+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:41.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:43:41.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.981+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:41.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.985+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:43:41.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:41.989+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:42.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.001+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:42.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.017+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:42.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.041+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:43:42.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.069+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:43:42.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:43:42.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.077+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:42.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.077+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:43:42.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.085+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:42.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.113+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:43:42.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:43:42.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:42.165 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 116 16 1489404 1489388 802.396 819.562 0.00139449 0.00123439 2024-09-16T03:43:42.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.165+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:43:42.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.165+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:43:42.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:43:42.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.201+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:43:42.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:43:42.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.229+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:43:42.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.229+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:43:42.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:43:42.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.245+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:42.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.245+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:43:42.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:43:42.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:43:42.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:42.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.305+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:42.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:43:42.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.313+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:42.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.337+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:43:42.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.341+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:42.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.345+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:43:42.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.393+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:43:42.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.397+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:42.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.409+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:43:42.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.409+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:42.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.413+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:42.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.421+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:43:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.445+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:42.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:43:42.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.449+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:42.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.453+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:43:42.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:43:42.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.493+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:43:42.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.497+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:42.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.501+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:43:42.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.505+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:43:42.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.505+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:43:42.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:42.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:43:42.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.557+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:43:42.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.561+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:43:42.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:43:42.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:42.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:43:42.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:43:42.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.669+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:42.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.673+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:42.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.693+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:43:42.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.693+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:43:42.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.705+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:42.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.713+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:43:42.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.733+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:43:42.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.745+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:42.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.749+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:43:42.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:43:42.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:43:42.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:42.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.793+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:43:42.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.801+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:43:42.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.805+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:43:42.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:43:42.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.813+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:42.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.813+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:43:42.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:43:42.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.845+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:43:42.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:43:42.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.869+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:43:42.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.869+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:43:42.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:42.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.885+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:43:42.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.893+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:42.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:43:42.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.937+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:43:42.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.953+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:43:42.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.953+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:42.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.957+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:43:42.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:43:42.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.985+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:43:42.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.993+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:43:42.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:42.993+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:43:43.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.021+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:43.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:43:43.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.061+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:43.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:43:43.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.085+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:43:43.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.085+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:43:43.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:43:43.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.137+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:43:43.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.137+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:43:43.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.149+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:43:43.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.149+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:43.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 117 15 1502454 1502439 802.51 815.688 0.000683093 0.0012342 2024-09-16T03:43:43.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.169+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:43:43.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.177+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:43:43.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:43.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.193+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:43.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.197+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:43.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:43:43.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:43:43.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.233+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:43.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.245+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:43.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.249+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:43:43.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.253+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:43.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.257+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:43:43.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.285+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:43:43.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.297+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:43:43.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.305+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:43:43.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.305+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:43:43.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:43:43.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.337+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:43:43.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.357+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:43:43.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.369+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:43:43.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:43:43.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.389+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:43:43.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.393+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:43.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.397+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:43:43.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.409+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:43:43.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.413+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:43.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.433+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:43:43.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.433+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:43:43.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.449+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:43:43.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.485+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:43:43.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.505+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:43:43.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.505+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:43:43.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.521+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:43:43.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.525+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:43:43.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:43:43.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.545+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:43.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.553+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:43:43.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.557+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:43.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.565+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:43:43.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.569+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:43.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.593+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:43:43.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.609+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:43:43.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.613+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:43.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:43:43.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:43:43.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.637+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:43:43.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:43:43.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.681+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:43:43.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.685+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:43.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.709+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:43:43.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:43.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.737+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:43.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.745+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:43:43.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.753+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:43:43.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.761+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:43:43.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.761+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:43:43.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.785+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:43.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:43:43.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.805+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:43:43.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.805+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:43:43.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:43:43.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.821+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:43:43.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.833+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:43.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:43:43.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.845+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:43:43.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.845+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:43:43.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:43.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.873+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:43.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:43:43.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:43.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.909+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:43.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:43.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.925+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:43:43.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:43:43.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:43.993+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:43:44.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.017+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:43:44.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.017+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:43:44.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:43:44.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.049+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:43:44.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:44.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.077+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:44.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.085+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:43:44.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:43:44.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.117+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:43:44.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.129+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:44.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.137+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:43:44.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.145+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:43:44.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 118 16 1515516 1515500 802.626 816.312 0.00070453 0.00123404 2024-09-16T03:43:44.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:43:44.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.173+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:43:44.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.189+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:43:44.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:43:44.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.205+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:43:44.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.209+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:43:44.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.217+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:43:44.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:43:44.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.265+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:43:44.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.269+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:44.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.281+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:43:44.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.293+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:44.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:43:44.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.321+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:43:44.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.337+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:43:44.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.349+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:44.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.349+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:43:44.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.365+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:44.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.369+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:43:44.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.385+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:43:44.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.385+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:43:44.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.397+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:43:44.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.417+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:43:44.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.421+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:44.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.437+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:43:44.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.461+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:43:44.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.461+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:44.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.465+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:43:44.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.465+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:43:44.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.469+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:43:44.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:43:44.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:43:44.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:43:44.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.533+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:43:44.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.537+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:44.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:43:44.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:44.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.577+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:43:44.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.577+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:44.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:43:44.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.617+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:43:44.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:43:44.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.645+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:43:44.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.657+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:43:44.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.657+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:43:44.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.673+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:43:44.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.673+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:43:44.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.677+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:44.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.689+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:43:44.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.693+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:43:44.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.713+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:43:44.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:43:44.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.749+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:43:44.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.781+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:44.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.789+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:44.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:43:44.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.833+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:43:44.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:43:44.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.853+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:43:44.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.865+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:44.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:43:44.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:43:44.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.877+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:43:44.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:43:44.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.889+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:43:44.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.901+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:44.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:43:44.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.929+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:43:44.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.941+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:43:44.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.961+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:43:44.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.961+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:43:44.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.981+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:43:44.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:44.985+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:43:45.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.013+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:45.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.017+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:45.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:45.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:45.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:45.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:45.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.077+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:43:45.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.101+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:45.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:43:45.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.125+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:43:45.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:43:45.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.145+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:43:45.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.145+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:45.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.153+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:45.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:45.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:43:45.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 119 16 1528779 1528763 802.846 828.938 0.000878874 0.00123366 2024-09-16T03:43:45.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.189+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:43:45.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.201+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:43:45.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.217+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:43:45.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:45.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.225+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:43:45.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.233+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:43:45.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.269+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:43:45.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.273+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:45.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.285+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:43:45.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.293+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:45.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:43:45.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.305+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:45.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.337+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:43:45.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.353+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:43:45.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.361+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:43:45.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:43:45.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.377+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:43:45.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:43:45.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.381+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:43:45.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.397+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:45.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.401+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:43:45.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.413+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:45.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.417+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:43:45.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.417+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:45.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.449+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:45.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.461+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:43:45.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:45.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.481+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:43:45.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.485+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:43:45.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.493+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:43:45.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.505+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:43:45.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.505+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:45.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.537+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:45.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.537+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:43:45.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.541+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:43:45.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.553+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:43:45.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.581+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:43:45.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:43:45.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:43:45.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.625+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:43:45.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.633+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:43:45.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:43:45.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.661+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:45.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:43:45.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.677+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:45.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:45.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.701+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:43:45.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:43:45.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.717+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:43:45.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.737+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:43:45.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:43:45.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.753+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:43:45.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:45.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.777+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:45.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:43:45.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.797+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:43:45.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.813+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:43:45.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.817+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:43:45.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.825+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:45.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.837+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:43:45.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.841+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:43:45.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.857+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:45.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.877+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:43:45.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:43:45.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.897+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:45.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.905+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:45.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:43:45.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.925+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:43:45.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.925+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:43:45.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:43:45.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.945+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:43:45.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.953+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:45.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.961+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:43:45.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:45.969+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:43:46.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.005+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:43:46.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.033+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:43:46.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:43:46.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:43:46.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.073+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:46.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:43:46.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:46.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.129+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:43:46.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.137+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:43:46.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.157+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:43:46.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.157+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:43:46.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:43:46.165634+0000 min lat: 0.000239237 max lat: 0.129137 avg lat: 0.00123357 2024-09-16T03:43:46.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:43:46.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 120 16 1541771 1541755 802.922 812 0.000803543 0.00123357 2024-09-16T03:43:46.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.169+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:43:46.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.177+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:43:46.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.193+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:43:46.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.197+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:43:46.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.213+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:43:46.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.245+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:43:46.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.249+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:43:46.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.253+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:43:46.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:43:46.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:46.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:46.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.289+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:43:46.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.297+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:43:46.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.297+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:43:46.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.321+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:46.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.325+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:46.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.329+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:43:46.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:46.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:43:46.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:43:46.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.369+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:43:46.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.373+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:46.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.393+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:46.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.401+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:43:46.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:43:46.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:43:46.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.433+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:43:46.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:43:46.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:46.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:43:46.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:46.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.485+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:46.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.509+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:43:46.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.521+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:46.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.541+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:46.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.553+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:43:46.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.557+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:46.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.569+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:46.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.569+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:43:46.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:43:46.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.581+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:43:46.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.601+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:43:46.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.601+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:43:46.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.613+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:46.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:46.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.661+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:46.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.673+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:43:46.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.677+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:43:46.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.689+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:43:46.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.689+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:43:46.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.697+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:43:46.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.697+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:43:46.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.721+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:43:46.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:46.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:46.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.765+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:43:46.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:43:46.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.793+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:46.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.801+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:43:46.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.809+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:46.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.821+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:43:46.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.833+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:43:46.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:43:46.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.889+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:46.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.889+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:43:46.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:43:46.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.897+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:43:46.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.909+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:43:46.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:46.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.933+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:43:46.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.933+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:46.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:46.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:43:47.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.001+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:43:47.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:47.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.005+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:43:47.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.021+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:43:47.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.033+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:43:47.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.057+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:43:47.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.077+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:43:47.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.089+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:43:47.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.093+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:43:47.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.113+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:43:47.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.117+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:47.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.125+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:47.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.129+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:43:47.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.145+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:43:47.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.145+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:43:47.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 121 16 1554639 1554623 802.933 804.25 0.000646763 0.00123354 2024-09-16T03:43:47.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.165+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:43:47.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:43:47.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.197+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:43:47.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.209+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:43:47.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.213+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:43:47.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.233+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:43:47.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.237+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:43:47.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:43:47.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.253+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:43:47.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.277+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:43:47.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:43:47.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.293+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:43:47.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.301+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:43:47.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.313+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:43:47.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:47.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.341+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:43:47.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.349+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:43:47.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.361+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:43:47.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.361+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:43:47.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.385+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:47.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.393+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:43:47.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:43:47.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.429+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:47.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.437+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:43:47.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.441+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:43:47.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.449+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:43:47.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.457+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:43:47.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.465+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:43:47.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:47.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.497+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:43:47.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.509+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:43:47.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.525+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:43:47.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:47.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:43:47.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:43:47.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.561+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:43:47.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.573+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:47.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.573+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:43:47.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.585+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:47.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:47.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.609+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:43:47.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:43:47.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.629+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:43:47.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:47.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:47.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:43:47.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.689+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:47.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.697+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:47.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:47.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.705+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:47.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:47.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:43:47.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:47.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.757+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:47.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.757+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:43:47.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:43:47.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:43:47.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.793+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:43:47.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.813+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:43:47.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.837+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:43:47.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.845+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:47.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.869+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:43:47.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.873+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:43:47.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:43:47.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:43:47.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.901+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:43:47.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.913+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:47.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:43:47.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.941+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:43:47.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.941+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:43:47.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:43:47.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:47.957+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:43:48.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.009+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:43:48.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.009+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:43:48.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.017+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:43:48.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:48.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.069+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:43:48.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.093+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:43:48.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:43:48.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.113+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:43:48.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.117+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:48.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:43:48.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.133+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:43:48.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.153+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:43:48.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 122 16 1567822 1567806 803.104 823.938 0.00106654 0.00123329 2024-09-16T03:43:48.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.165+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:43:48.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.181+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:43:48.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.181+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:43:48.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:43:48.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.205+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:43:48.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.209+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:43:48.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.221+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:48.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.225+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:48.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.249+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:48.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.261+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:43:48.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.285+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:43:48.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:43:48.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.297+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:43:48.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:48.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:43:48.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.333+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:43:48.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.353+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:43:48.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.357+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:43:48.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.365+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:43:48.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.373+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:43:48.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.381+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:48.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:43:48.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.409+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:48.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.417+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:48.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.437+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:43:48.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.449+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:48.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.457+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:43:48.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.461+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:48.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.461+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:48.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:43:48.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.493+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:43:48.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.517+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:43:48.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:48.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:48.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.537+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:43:48.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.541+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:43:48.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.569+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:43:48.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.589+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:43:48.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.593+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:48.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.593+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:43:48.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.601+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:43:48.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.605+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:43:48.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:43:48.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.637+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:43:48.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.641+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:43:48.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:48.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.661+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:43:48.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.677+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:43:48.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.689+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:43:48.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.705+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:43:48.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.705+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:43:48.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.721+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:43:48.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.757+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:43:48.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.769+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:43:48.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.781+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:43:48.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.801+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:43:48.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:43:48.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.817+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:43:48.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.833+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:43:48.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.853+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:43:48.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.853+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:48.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.853+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:43:48.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:43:48.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.889+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:48.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:43:48.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.901+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:43:48.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.905+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:43:48.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.905+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:43:48.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.933+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:43:48.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.949+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:43:48.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:43:48.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:43:48.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.961+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:43:48.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.973+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:43:48.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:48.977+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:49.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:43:49.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:43:49.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:43:49.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.049+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:43:49.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.061+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:43:49.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:43:49.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:43:49.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.097+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:49.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:43:49.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.125+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:43:49.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:43:49.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.133+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:43:49.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.149+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:43:49.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:43:49.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.157+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:49.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 123 16 1580953 1580937 803.247 820.688 0.000573354 0.00123305 2024-09-16T03:43:49.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.189+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:49.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.205+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:43:49.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.213+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:43:49.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.217+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:43:49.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.225+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:43:49.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.229+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:43:49.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.233+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:43:49.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.233+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:43:49.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:43:49.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.257+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:43:49.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.281+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:43:49.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.309+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:43:49.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.329+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:49.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:43:49.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.345+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:49.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.345+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:43:49.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.381+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:43:49.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:43:49.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.385+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:43:49.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.433+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:43:49.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:43:49.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.453+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:43:49.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.457+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:49.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:49.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.473+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:43:49.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.493+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:43:49.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.493+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:49.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.493+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:43:49.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:49.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:49.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:43:49.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:49.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.565+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:43:49.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.565+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:43:49.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:43:49.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:49.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:49.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.601+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:49.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.605+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:43:49.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.609+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:43:49.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:43:49.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.625+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:43:49.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.641+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:43:49.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.649+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:49.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.653+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:43:49.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.657+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:43:49.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.673+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:43:49.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.689+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:49.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.701+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:43:49.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.709+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:43:49.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.717+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:43:49.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.725+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:43:49.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.733+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:43:49.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.737+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:49.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.757+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:43:49.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.773+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:43:49.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.777+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:43:49.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.797+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:49.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.801+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:43:49.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:43:49.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.809+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:49.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:43:49.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.857+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:49.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.881+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:49.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:49.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.897+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:43:49.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.905+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:43:49.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.917+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:43:49.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.921+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:43:49.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:49.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:43:49.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:43:49.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.953+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:43:49.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:43:49.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:43:50.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.993+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:43:50.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:49.997+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:50.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:43:50.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.049+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:50.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.053+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:43:50.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.073+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:43:50.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.077+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:50.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.081+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:43:50.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.149+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:43:50.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 124 16 1593195 1593179 802.939 765.125 0.000963886 0.00123354 2024-09-16T03:43:50.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.173+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:43:50.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.189+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:43:50.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.205+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:43:50.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.225+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:43:50.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:43:50.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.273+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:43:50.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.273+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:43:50.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.277+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:43:50.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.301+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:43:50.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:43:50.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:43:50.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.325+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:43:50.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.329+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:50.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:43:50.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.349+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:43:50.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.357+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:43:50.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.373+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:50.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.381+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:43:50.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.401+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:43:50.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.405+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:43:50.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:43:50.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.425+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:43:50.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.457+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:50.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.461+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:43:50.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:43:50.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.481+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:43:50.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.489+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:43:50.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.497+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:50.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:43:50.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.541+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:43:50.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.545+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:43:50.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:43:50.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.581+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:43:50.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.581+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:43:50.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.585+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:50.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.613+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:43:50.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.625+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:43:50.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.633+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:43:50.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:43:50.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.641+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:43:50.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:43:50.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.669+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:43:50.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.677+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:50.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.725+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:43:50.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.725+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:43:50.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.729+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:43:50.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.753+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:50.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.757+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:43:50.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.765+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:43:50.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.785+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:43:50.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.793+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:43:50.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:43:50.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.813+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:50.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:43:50.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:50.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.853+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:43:50.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.857+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:43:50.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:43:50.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.885+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:50.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.897+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:43:50.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.897+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:43:50.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:43:50.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:43:50.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.949+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:43:50.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.965+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:43:50.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:50.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.977+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:43:50.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:43:50.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:50.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:51.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.013+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:43:51.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.021+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:43:51.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:43:51.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:43:51.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.053+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:43:51.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.073+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:43:51.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.077+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:43:51.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:43:51.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.105+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:51.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.109+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:43:51.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.121+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:51.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.125+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:43:51.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.145+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:43:51.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.153+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:43:51.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.157+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:43:51.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.161+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:43:51.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 125 16 1606287 1606271 803.06 818.25 0.00080901 0.00123335 2024-09-16T03:43:51.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.181+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:43:51.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.189+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:43:51.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.189+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:43:51.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:43:51.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.237+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:43:51.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:43:51.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:43:51.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.261+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:43:51.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:51.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.277+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:43:51.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:43:51.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:43:51.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.301+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:43:51.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:43:51.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:43:51.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.329+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:43:51.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.353+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:43:51.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.357+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:43:51.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:51.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.365+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:51.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.365+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:43:51.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.401+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:43:51.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.405+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:51.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.433+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:43:51.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.445+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:51.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:43:51.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.449+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:43:51.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.469+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:43:51.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.477+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:43:51.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.477+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:43:51.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.489+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:43:51.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.493+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:43:51.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.521+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:43:51.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:43:51.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.529+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:51.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:43:51.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:43:51.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.561+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:43:51.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.561+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:51.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.577+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:43:51.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:43:51.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.597+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:43:51.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.613+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:43:51.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:43:51.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:51.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.645+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:51.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:43:51.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:43:51.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:43:51.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.665+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:51.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.685+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:43:51.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:51.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.721+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:43:51.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.725+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:51.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.729+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:43:51.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:43:51.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.765+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:43:51.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.777+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:43:51.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:51.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.801+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:43:51.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.821+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:43:51.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.821+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:43:51.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.833+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:43:51.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.845+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:43:51.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.845+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:43:51.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:43:51.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.869+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:43:51.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:43:51.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.893+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:43:51.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:43:51.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.945+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:43:51.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.949+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:43:51.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:43:51.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.969+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:43:51.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.981+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:43:51.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:43:52.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:51.997+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:43:52.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.009+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:43:52.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.013+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:43:52.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.017+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:43:52.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:43:52.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:43:52.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:43:52.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.073+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:43:52.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.085+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:43:52.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.089+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:43:52.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.097+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:43:52.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:43:52.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.109+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:43:52.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.113+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:52.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.117+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:43:52.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.153+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:52.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 126 16 1619163 1619147 803.073 804.75 0.000422263 0.00123327 2024-09-16T03:43:52.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.173+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:43:52.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.181+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:52.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:43:52.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.185+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:43:52.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.201+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:43:52.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.221+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:43:52.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.229+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:43:52.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:43:52.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.253+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:43:52.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.269+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:52.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.269+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:43:52.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.285+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:43:52.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.293+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:43:52.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.301+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:43:52.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.301+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:43:52.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.321+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:43:52.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.337+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:43:52.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:43:52.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.365+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:43:52.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.385+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:43:52.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:43:52.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:43:52.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.421+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:43:52.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.437+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:43:52.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.445+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:52.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.453+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:43:52.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.457+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:43:52.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.473+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:52.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.493+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:43:52.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.497+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:43:52.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:52.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.509+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:43:52.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:43:52.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.537+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:43:52.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:43:52.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.577+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:52.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:43:52.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.585+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:43:52.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.585+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:43:52.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:43:52.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:52.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:52.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.673+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:43:52.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.673+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:52.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.677+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:43:52.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:43:52.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.725+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:52.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.741+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:43:52.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.741+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:43:52.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:43:52.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:43:52.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:43:52.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.813+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:43:52.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.813+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:43:52.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.813+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:43:52.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.817+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:43:52.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.841+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:43:52.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.849+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:43:52.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.849+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:43:52.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.873+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:43:52.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.885+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:43:52.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:52.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.905+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:43:52.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.909+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:43:52.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.945+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:43:52.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:52.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.949+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:43:52.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:43:52.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.965+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:43:52.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:52.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:52.985+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:43:53.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:43:53.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:43:53.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.037+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:43:53.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.061+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:43:53.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.085+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:53.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.089+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:43:53.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.109+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:43:53.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.129+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:43:53.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.137+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:43:53.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.149+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:43:53.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.153+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:43:53.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:43:53.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 127 16 1632106 1632090 803.119 808.938 0.00113419 0.00123326 2024-09-16T03:43:53.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.173+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:43:53.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.177+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:43:53.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.181+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:53.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.193+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:43:53.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.197+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:53.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.197+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:43:53.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.213+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:43:53.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:43:53.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.221+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:43:53.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:43:53.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.257+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:43:53.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.269+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:43:53.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.277+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:43:53.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:43:53.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:43:53.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.297+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:43:53.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.309+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:53.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:43:53.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.317+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:43:53.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.321+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:43:53.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.341+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:53.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.357+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:53.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.365+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:43:53.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.377+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:43:53.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.381+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:43:53.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.381+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:43:53.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:53.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.401+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:53.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.417+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:53.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.425+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:43:53.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.445+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:43:53.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:43:53.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.465+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:43:53.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.473+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:43:53.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.485+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:43:53.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:43:53.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:53.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.497+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:43:53.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.513+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:43:53.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.525+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:43:53.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:43:53.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:43:53.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.573+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:43:53.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:43:53.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.597+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:43:53.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.617+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:43:53.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.621+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:43:53.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:43:53.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.637+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:53.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.641+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:53.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.657+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:43:53.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.681+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:43:53.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.685+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:43:53.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.685+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:43:53.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:43:53.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.709+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:43:53.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.709+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:43:53.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:43:53.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.749+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:53.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.757+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:43:53.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.769+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:43:53.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:43:53.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.785+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:43:53.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.793+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:43:53.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.805+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:43:53.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:43:53.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:43:53.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.853+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:43:53.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.861+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:53.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:43:53.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.889+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:43:53.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.917+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:53.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.921+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:43:53.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.937+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:53.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.945+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:43:53.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.969+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:43:53.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:54.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:53.997+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:43:54.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:43:54.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.005+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:54.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.017+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:54.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.029+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:43:54.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:43:54.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.053+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:43:54.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.069+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:43:54.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.077+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:43:54.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.081+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:43:54.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.089+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:43:54.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:43:54.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.105+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:43:54.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.109+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:43:54.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.125+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:43:54.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.125+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:43:54.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.133+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:43:54.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:43:54.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 128 16 1644875 1644859 803.079 798.062 0.0037419 0.00123328 2024-09-16T03:43:54.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:43:54.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.197+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:43:54.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:43:54.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:43:54.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.229+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:54.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.233+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:54.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:43:54.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:43:54.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.253+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:43:54.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:43:54.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.281+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:43:54.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.313+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:43:54.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.325+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:43:54.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:43:54.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:43:54.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.373+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:43:54.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:54.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.385+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:43:54.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.445+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:43:54.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:43:54.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.481+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:43:54.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.481+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:43:54.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.489+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:43:54.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.493+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:54.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:54.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.497+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:43:54.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:43:54.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.537+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:43:54.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.545+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:43:54.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.561+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:43:54.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:43:54.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.625+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:43:54.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.625+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:43:54.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.633+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:43:54.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:54.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:43:54.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.669+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:54.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.677+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:43:54.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.677+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:43:54.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:43:54.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.705+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:54.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.713+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:43:54.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.737+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:43:54.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.745+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:43:54.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:43:54.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.777+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:43:54.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.781+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:43:54.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.793+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:43:54.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.801+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:54.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:43:54.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.813+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:43:54.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.833+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:43:54.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.857+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:43:54.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:43:54.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.877+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:43:54.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:43:54.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:43:54.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.909+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:43:54.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:43:54.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.921+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:43:54.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:43:54.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.949+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:43:54.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:54.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.977+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:43:54.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:54.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:43:55.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.001+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:55.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:55.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:43:55.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:43:55.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.053+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:43:55.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.061+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:55.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.069+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:43:55.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.073+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:43:55.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.085+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:43:55.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.113+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:43:55.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.145+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:55.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:43:55.166 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 129 16 1658149 1658133 803.284 829.625 0.000513277 0.001233 2024-09-16T03:43:55.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.165+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:43:55.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.173+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:43:55.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:43:55.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.181+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:43:55.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.209+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:43:55.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.217+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:43:55.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.229+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:43:55.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.241+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:43:55.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.245+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:43:55.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.257+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:43:55.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.261+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:55.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.265+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:43:55.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.269+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:43:55.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.277+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:43:55.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.321+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:43:55.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:55.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.337+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:43:55.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.357+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:43:55.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.369+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:43:55.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.373+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:43:55.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.389+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:43:55.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:43:55.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.409+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:43:55.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.413+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:43:55.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.429+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:55.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.453+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:43:55.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.469+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:43:55.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.473+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:43:55.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.477+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:43:55.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.485+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:43:55.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.521+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:43:55.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.529+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:43:55.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.529+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:43:55.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.545+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:43:55.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.569+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:43:55.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:43:55.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.585+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:43:55.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.605+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:43:55.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.609+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:43:55.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.609+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:43:55.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.625+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:43:55.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.653+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:43:55.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:43:55.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.677+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:43:55.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:43:55.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.689+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:43:55.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.697+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:43:55.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.709+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:43:55.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.717+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:43:55.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.733+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:43:55.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.745+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:43:55.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.749+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:43:55.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:43:55.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.769+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:43:55.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.789+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:43:55.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.789+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:43:55.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:55.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:55.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.829+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:43:55.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.833+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:43:55.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.845+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:43:55.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:43:55.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.877+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:43:55.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.877+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:43:55.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.921+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:43:55.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.932+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:43:55.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.936+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:43:55.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.964+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:43:55.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:43:55.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:55.980+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:43:56.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.008+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:43:56.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:56.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:43:56.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.048+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:43:56.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.048+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:43:56.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:43:56.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.088+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:43:56.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.092+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:43:56.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.096+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:43:56.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.120+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:43:56.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.128+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:43:56.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:43:56.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.156+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:43:56.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.156+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:43:56.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 130 16 1671441 1671425 803.495 830.75 0.000712721 0.00123268 2024-09-16T03:43:56.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:43:56.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.180+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:43:56.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.196+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:43:56.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:43:56.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:43:56.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.232+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:43:56.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.256+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:43:56.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.288+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:43:56.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.300+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:43:56.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.300+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:43:56.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.320+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:43:56.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.336+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:43:56.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:56.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.344+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:43:56.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.348+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:43:56.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.356+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:43:56.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.368+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:43:56.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.372+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:43:56.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.384+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:43:56.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.396+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:43:56.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.408+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:43:56.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:43:56.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.428+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:43:56.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.440+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:56.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.448+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:56.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.452+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:43:56.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:43:56.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:43:56.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.512+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:43:56.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.516+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:43:56.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:43:56.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.536+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:43:56.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.560+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:43:56.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.568+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:43:56.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.580+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:43:56.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.580+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:43:56.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.584+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:56.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.624+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:43:56.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.632+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:43:56.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.632+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:43:56.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.640+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:43:56.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.668+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:43:56.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.668+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:43:56.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.672+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:43:56.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.684+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:56.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.684+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:43:56.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.696+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:43:56.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.704+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:43:56.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.720+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:56.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:43:56.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.744+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:43:56.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.752+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:43:56.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.768+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:43:56.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:43:56.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.788+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:43:56.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.792+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:43:56.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.800+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:56.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.816+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:43:56.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.828+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:43:56.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:43:56.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.848+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:43:56.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.860+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:56.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.880+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:43:56.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.884+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:43:56.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.896+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:43:56.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.908+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:43:56.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.912+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:43:56.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:43:56.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.944+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:43:56.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.960+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:43:56.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.960+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:43:56.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.964+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:43:56.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.964+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:43:56.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:56.968+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:43:57.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:43:57.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.008+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:43:57.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:43:57.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.040+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:43:57.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.060+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:57.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.072+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:43:57.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.080+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:43:57.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.088+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:43:57.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.096+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:43:57.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.096+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:43:57.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:43:57.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:43:57.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:43:57.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.116+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:43:57.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.152+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:43:57.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 131 16 1684525 1684509 803.603 817.75 0.000589774 0.00123252 2024-09-16T03:43:57.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.180+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:43:57.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.188+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:57.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:43:57.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:57.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.240+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:43:57.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.244+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:43:57.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.260+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:43:57.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.272+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:43:57.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.272+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:43:57.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:43:57.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.296+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:43:57.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.308+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:57.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:43:57.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.324+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:43:57.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.336+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:43:57.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.340+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:43:57.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.352+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:43:57.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.356+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:43:57.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.356+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:43:57.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.384+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:43:57.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.396+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:43:57.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.400+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:43:57.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.400+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:43:57.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.412+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:43:57.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.424+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:43:57.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.444+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:43:57.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:57.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.452+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:43:57.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.460+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:43:57.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.460+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:43:57.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.472+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:57.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.476+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:43:57.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:43:57.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:43:57.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.516+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:43:57.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.532+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:43:57.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.536+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:43:57.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.552+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:43:57.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:43:57.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.572+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:43:57.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.592+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:43:57.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:43:57.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:43:57.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.616+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:43:57.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:43:57.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.660+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:43:57.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.664+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:43:57.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.688+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:43:57.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.692+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:43:57.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.692+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:43:57.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.708+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:57.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.720+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:57.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.724+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:43:57.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.728+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:43:57.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.744+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:43:57.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.748+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:43:57.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.772+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:43:57.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.780+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:43:57.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:43:57.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:43:57.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.796+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:43:57.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.812+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:43:57.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.816+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:43:57.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.820+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:43:57.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.828+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:43:57.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.836+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:43:57.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:43:57.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.868+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:43:57.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.880+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:43:57.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.884+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:43:57.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.920+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:57.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.924+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:43:57.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.948+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:43:57.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.964+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:43:57.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.968+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:43:57.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.984+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:43:57.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.988+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:43:57.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.988+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:43:58.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:57.996+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:43:58.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:43:58.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.012+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:43:58.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.016+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:43:58.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.020+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:43:58.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.036+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:43:58.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.044+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:43:58.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.052+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:43:58.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.068+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:43:58.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.076+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:43:58.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.084+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:43:58.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.096+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:43:58.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:43:58.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.112+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:43:58.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.140+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:43:58.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.144+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:43:58.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:43:58.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:43:58.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.160+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:58.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 132 16 1697577 1697561 803.694 815.75 0.00055024 0.00123237 2024-09-16T03:43:58.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.168+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:43:58.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.172+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:43:58.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.180+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:43:58.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.200+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:43:58.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.204+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:43:58.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.204+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:43:58.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.212+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:43:58.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.248+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:43:58.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:43:58.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.256+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:43:58.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.272+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:43:58.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.276+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:43:58.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.304+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:43:58.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.304+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:43:58.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.320+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:43:58.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:43:58.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.328+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:43:58.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.348+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:43:58.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.348+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:43:58.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.356+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:43:58.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.392+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:43:58.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.408+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:43:58.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.416+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:43:58.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.428+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:43:58.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.432+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:43:58.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.432+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:43:58.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.460+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:43:58.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:43:58.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.476+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:43:58.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:43:58.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.484+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:43:58.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.496+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:43:58.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.504+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:43:58.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:43:58.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:43:58.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:58.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.532+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:43:58.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.548+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:43:58.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.556+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:43:58.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.564+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:58.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.576+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:43:58.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.576+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:58.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.596+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:43:58.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.600+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:43:58.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:43:58.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.620+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:43:58.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.624+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:58.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.640+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:43:58.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.664+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:43:58.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.664+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:43:58.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:43:58.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.688+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:43:58.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:58.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:43:58.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.724+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:43:58.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.728+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:43:58.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:43:58.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.744+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:43:58.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:43:58.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.780+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:43:58.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.780+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:43:58.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.780+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:43:58.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.808+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:43:58.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.820+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:43:58.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.836+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:43:58.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.848+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:43:58.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.856+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:43:58.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.860+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:43:58.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.880+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:43:58.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.880+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:43:58.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.888+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:43:58.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:43:58.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.900+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:43:58.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.912+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:43:58.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.940+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:43:58.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:43:58.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.956+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:43:58.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.968+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:43:58.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.976+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:43:58.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:58.988+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:43:59.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.004+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:43:59.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:43:59.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.028+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:43:59.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.032+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:43:59.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.036+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:43:59.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.040+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:43:59.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.056+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:43:59.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:43:59.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.076+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:43:59.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.092+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:59.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.100+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:43:59.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:43:59.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.124+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:43:59.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:43:59.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.136+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:43:59.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.140+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:43:59.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:43:59.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.144+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:43:59.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 133 16 1710849 1710833 803.888 829.5 0.000621228 0.00123206 2024-09-16T03:43:59.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.176+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:43:59.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.188+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:43:59.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.208+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:43:59.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.232+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:43:59.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:43:59.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.256+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:43:59.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.260+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:43:59.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.260+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:43:59.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.272+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:43:59.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:43:59.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.300+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:43:59.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.300+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:43:59.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.304+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:43:59.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.320+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:43:59.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.332+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:43:59.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.348+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:43:59.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.356+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:43:59.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.360+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:43:59.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.396+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:43:59.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.404+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:43:59.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.404+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:43:59.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.408+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:43:59.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:43:59.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.428+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:43:59.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.432+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:43:59.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.468+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:43:59.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.476+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:43:59.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.480+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:43:59.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:43:59.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:43:59.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:43:59.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:43:59.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.544+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:43:59.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:43:59.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.568+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:43:59.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.568+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:43:59.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.584+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:43:59.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.596+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:43:59.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:43:59.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.648+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:43:59.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.648+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:43:59.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.672+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:43:59.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.672+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:43:59.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.676+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:43:59.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.720+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:43:59.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:43:59.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:43:59.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.748+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:43:59.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.776+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:43:59.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.780+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:43:59.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.780+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:43:59.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:43:59.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.808+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:43:59.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.816+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:43:59.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:43:59.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:43:59.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.868+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:43:59.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.884+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:43:59.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.884+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:43:59.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.892+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:43:59.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.912+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:43:59.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.912+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:43:59.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.920+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:43:59.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.956+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:43:59.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.972+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:43:59.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:43:59.992+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:44:00.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.012+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:00.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.020+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:44:00.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:44:00.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.056+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:44:00.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.068+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:44:00.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:00.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.072+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:44:00.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.096+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:44:00.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.100+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:44:00.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.136+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:44:00.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.144+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:44:00.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.156+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:44:00.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 134 16 1723599 1723583 803.835 796.875 0.0007217 0.00123216 2024-09-16T03:44:00.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.172+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:00.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.180+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:44:00.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.184+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:44:00.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.188+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:44:00.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.224+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:44:00.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.232+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:44:00.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.232+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:44:00.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:00.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.292+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:00.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.300+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:44:00.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.320+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:44:00.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.320+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:44:00.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.332+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:00.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.344+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:44:00.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.368+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:44:00.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:00.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:44:00.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.404+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:44:00.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.408+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:00.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:44:00.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.436+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:44:00.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.452+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:44:00.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:44:00.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.464+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:44:00.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.472+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:44:00.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.472+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:44:00.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.480+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:00.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:44:00.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.524+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:44:00.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:00.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.540+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:00.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:44:00.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:00.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.580+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:44:00.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.600+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:44:00.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.624+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:00.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:00.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.652+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:44:00.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.652+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:00.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.668+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:44:00.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:44:00.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:00.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.692+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:00.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:00.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.720+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:44:00.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.724+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:00.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.724+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:00.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.748+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:44:00.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:00.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.792+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:44:00.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.796+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:44:00.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.796+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:00.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.816+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:44:00.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.820+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:44:00.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.836+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:44:00.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:44:00.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.848+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:44:00.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.864+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:44:00.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.868+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:44:00.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.880+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:44:00.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.908+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:44:00.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.916+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:00.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.928+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:44:00.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.944+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:00.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.956+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:44:00.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.964+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:44:00.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.964+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:44:00.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.984+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:01.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:00.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:44:01.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.016+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:01.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.024+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:44:01.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.036+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:44:01.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:01.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:44:01.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.052+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:44:01.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.064+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:44:01.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.080+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:44:01.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.080+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:44:01.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.104+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:44:01.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.108+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:44:01.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.128+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:44:01.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.140+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:44:01.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.140+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:01.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:01.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 135 16 1736729 1736713 803.959 820.625 0.000921787 0.00123196 2024-09-16T03:44:01.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.168+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:44:01.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.172+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:44:01.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.200+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:44:01.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:44:01.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.216+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:01.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.236+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:01.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.240+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:01.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.252+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:01.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.272+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:44:01.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.288+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:01.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.288+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:44:01.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.300+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:44:01.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.308+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:44:01.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.332+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:44:01.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.336+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:01.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.340+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:44:01.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:44:01.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.352+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:44:01.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.360+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:44:01.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.392+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:01.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:44:01.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:01.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.416+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:01.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.428+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:01.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.448+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:44:01.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.452+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:01.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.476+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:44:01.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.480+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:44:01.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.488+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:44:01.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.508+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:44:01.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.524+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:01.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.528+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:44:01.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.532+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:44:01.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.548+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:01.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:44:01.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.556+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:44:01.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.568+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:44:01.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.580+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:44:01.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.588+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:01.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.600+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:44:01.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.608+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:01.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.624+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:01.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.632+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:44:01.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.640+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:44:01.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.676+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:01.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.676+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:44:01.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.684+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:44:01.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.708+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:44:01.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.716+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:44:01.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.720+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:44:01.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.720+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:44:01.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.728+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:01.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.736+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:01.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.744+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:44:01.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.764+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:44:01.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:44:01.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.788+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:44:01.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.800+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:44:01.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.828+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:44:01.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:44:01.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.856+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:44:01.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.860+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:44:01.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.872+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:44:01.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.896+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:01.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.900+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:01.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.916+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:01.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.920+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:01.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.928+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:44:01.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:44:01.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:44:01.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:44:01.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:01.968+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:02.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.000+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:44:02.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.012+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:02.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.016+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:44:02.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.032+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:44:02.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.036+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:02.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.060+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:02.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.064+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:44:02.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.084+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:44:02.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.088+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:02.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:02.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.096+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:44:02.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.108+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:44:02.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.116+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:02.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.132+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:44:02.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 136 15 1749964 1749949 804.13 827.25 0.00079608 0.00123171 2024-09-16T03:44:02.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:44:02.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:44:02.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.188+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:44:02.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:44:02.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:44:02.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.228+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:02.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:44:02.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:02.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:02.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.268+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:02.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.276+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:02.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.284+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:44:02.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.288+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:44:02.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:02.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.340+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:44:02.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.348+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:44:02.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:44:02.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.384+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:44:02.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.384+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:02.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.388+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:44:02.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.388+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:44:02.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.388+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:44:02.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:02.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.436+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:44:02.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.440+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:44:02.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:44:02.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.464+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:02.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.464+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:44:02.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.480+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:44:02.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.500+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:44:02.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.500+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:02.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.516+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:44:02.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.532+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:44:02.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.536+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:02.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.536+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:44:02.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:02.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.556+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:44:02.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.564+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:02.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.576+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:44:02.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:02.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.584+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:44:02.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:44:02.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.620+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:02.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.624+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:44:02.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:44:02.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.644+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:44:02.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.664+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:44:02.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:44:02.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.684+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:02.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.692+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:44:02.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.712+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:44:02.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.712+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:44:02.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.744+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:44:02.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.748+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:44:02.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.756+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:44:02.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:44:02.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:44:02.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.788+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:44:02.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.808+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:44:02.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.808+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:02.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.816+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:44:02.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.832+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:02.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:44:02.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.840+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:02.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:02.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.852+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:44:02.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:44:02.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.872+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:44:02.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.876+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:44:02.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:44:02.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.912+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:02.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:44:02.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.944+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:44:02.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.952+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:02.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.968+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:44:02.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.976+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:44:02.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.980+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:44:02.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.984+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:44:03.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:02.996+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:44:03.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.000+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:03.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.020+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:44:03.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.032+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:44:03.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.032+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:44:03.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.044+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:03.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:44:03.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:44:03.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.076+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:44:03.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.084+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:03.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.092+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:44:03.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.112+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:44:03.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:44:03.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.120+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:44:03.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.120+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:44:03.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.136+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:44:03.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 137 16 1762645 1762629 804.044 792.5 0.000694829 0.00123183 2024-09-16T03:44:03.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.180+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:44:03.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.180+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:44:03.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.180+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:44:03.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.204+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:03.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:44:03.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.236+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:44:03.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.236+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:44:03.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.256+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:44:03.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.260+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:44:03.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.260+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:03.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.280+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:03.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.288+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:44:03.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:44:03.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:44:03.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.304+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:44:03.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.324+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:03.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.336+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:44:03.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.344+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:03.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:44:03.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.360+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:44:03.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.408+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:44:03.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.412+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:03.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.432+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:03.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.440+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:44:03.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.464+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:44:03.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.476+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:03.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.480+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:44:03.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.480+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:03.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.496+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:44:03.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.504+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:03.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:44:03.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.544+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:44:03.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.548+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:03.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.568+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:03.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.584+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:44:03.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.600+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:44:03.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.616+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:44:03.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.620+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:03.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.620+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:03.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.656+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:44:03.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.656+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:44:03.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.668+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:44:03.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.672+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:03.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.672+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:03.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.684+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:44:03.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.688+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:44:03.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.704+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:44:03.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.724+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:03.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:44:03.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.740+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:44:03.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.768+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:03.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.772+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:44:03.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:44:03.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.804+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:44:03.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.816+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:44:03.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:03.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.840+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:44:03.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.848+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:44:03.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.868+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:03.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.868+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:44:03.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.876+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:44:03.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:44:03.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.904+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:44:03.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.936+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:03.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.936+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:44:03.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.944+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:03.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:44:03.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.960+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:03.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.968+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:03.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.976+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:03.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:44:04.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:03.996+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:04.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:04.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:44:04.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.024+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:04.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.036+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:44:04.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.068+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:04.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.084+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:44:04.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.088+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:44:04.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:44:04.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.120+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:44:04.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.136+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:44:04.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.136+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:04.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.148+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:44:04.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.152+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:44:04.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 138 16 1775893 1775877 804.217 828 0.0010771 0.00123156 2024-09-16T03:44:04.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.168+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:04.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.188+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:04.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:44:04.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:44:04.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.212+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:44:04.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.212+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:44:04.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.220+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:44:04.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.232+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:44:04.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:44:04.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.276+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:44:04.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.276+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:44:04.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.288+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:44:04.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:44:04.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.304+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:04.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.304+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:04.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.312+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:04.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.328+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:44:04.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.332+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:44:04.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.344+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:44:04.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.344+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:44:04.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:04.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.388+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:44:04.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.396+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:44:04.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.420+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:44:04.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.436+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:44:04.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.448+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:44:04.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.460+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:04.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.460+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:44:04.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:04.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.484+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:44:04.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.504+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:04.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:44:04.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.540+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:44:04.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.560+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:44:04.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.560+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:04.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.564+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:44:04.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:04.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.588+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:44:04.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.600+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:44:04.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.600+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:44:04.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.604+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:44:04.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:04.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.616+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:04.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:44:04.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:44:04.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.752+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:04.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.764+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:44:04.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:44:04.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.800+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:44:04.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.800+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:04.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.808+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:44:04.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.812+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:44:04.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.812+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:44:04.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.824+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:44:04.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:44:04.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.860+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:44:04.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.864+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:04.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.884+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:04.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:44:04.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.896+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:44:04.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.904+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:44:04.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:44:04.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:04.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:44:04.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.968+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:44:04.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.972+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:44:04.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.980+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:44:04.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:44:04.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:04.988+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:05.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.016+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:44:05.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:44:05.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.016+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:44:05.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.028+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:05.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.036+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:05.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.056+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:44:05.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.064+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:05.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:05.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.160+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:44:05.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 139 16 1786405 1786389 803.158 657 0.00129686 0.00123322 2024-09-16T03:44:05.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.164+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:05.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.164+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:44:05.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.164+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:05.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:44:05.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.188+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:44:05.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.220+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:44:05.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.244+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:05.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:05.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.252+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:44:05.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.256+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:05.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.272+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:05.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.292+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:05.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.300+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:44:05.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.308+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:44:05.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:44:05.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:05.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.328+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:44:05.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:44:05.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.352+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:44:05.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.360+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:44:05.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.384+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:44:05.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.400+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:44:05.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.408+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:44:05.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.416+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:44:05.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:44:05.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.436+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:44:05.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.452+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:44:05.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.472+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:44:05.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.492+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:44:05.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.500+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:44:05.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:44:05.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.512+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:44:05.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.512+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:44:05.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.528+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:44:05.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.540+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:44:05.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.552+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:44:05.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.560+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:44:05.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.580+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:44:05.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.612+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:05.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:44:05.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.632+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:05.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.636+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:44:05.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.644+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:44:05.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.652+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:44:05.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.660+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:44:05.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.668+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:44:05.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.692+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:44:05.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.700+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:05.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.704+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:44:05.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.720+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:44:05.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.720+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:44:05.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:44:05.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.740+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:44:05.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:44:05.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:44:05.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.760+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:44:05.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.764+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:44:05.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.792+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:05.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.800+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:44:05.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:05.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.820+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:44:05.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.820+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:05.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.828+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:44:05.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.844+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:44:05.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.856+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:44:05.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.860+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:44:05.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.864+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:05.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.880+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:44:05.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.884+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:05.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.908+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:44:05.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.920+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:44:05.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.924+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:05.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:44:05.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.940+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:44:05.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.960+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:05.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:44:05.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.980+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:44:05.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:05.988+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:44:06.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.000+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:44:06.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.012+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:44:06.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:44:06.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.036+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:06.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.052+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:44:06.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.052+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:44:06.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.064+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:44:06.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.064+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:44:06.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:06.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.084+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:44:06.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.104+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:44:06.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.112+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:06.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.120+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:44:06.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.124+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:44:06.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:44:06.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:44:06.167380+0000 min lat: 0.00023671 max lat: 0.129137 avg lat: 0.00123346 2024-09-16T03:44:06.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:44:06.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 140 16 1798908 1798892 803.002 781.438 0.000671648 0.00123346 2024-09-16T03:44:06.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.176+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:44:06.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.184+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:44:06.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.188+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:44:06.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:44:06.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.212+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:06.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.220+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:06.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.232+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:44:06.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.232+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:06.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.240+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:44:06.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.248+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:06.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.252+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.264+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.272+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.324+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.348+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.352+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.368+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.368+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.372+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:44:06.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.384+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.400+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.456+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.488+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.492+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.492+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.500+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.536+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.552+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:44:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.560+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:44:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.596+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:44:06.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.612+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:44:06.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.628+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:44:06.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.628+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:06.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.644+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:44:06.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.660+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:44:06.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.664+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:06.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:44:06.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:06.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.716+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:06.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.716+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:44:06.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.732+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:44:06.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.744+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:44:06.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:44:06.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.756+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:06.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.768+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:44:06.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:44:06.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.800+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:44:06.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.804+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:06.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:44:06.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.844+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:44:06.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.848+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:06.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.852+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:44:06.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.868+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:44:06.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:06.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.892+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:44:06.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:44:06.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:06.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.936+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:06.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.944+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:44:06.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.948+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:44:06.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.976+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:44:06.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.984+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:44:06.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:44:07.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:06.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:44:07.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.016+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:44:07.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.016+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:44:07.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:07.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:07.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.056+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:44:07.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.076+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:44:07.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.080+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:07.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.088+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:44:07.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:44:07.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:44:07.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.124+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:44:07.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.140+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:07.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.144+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:44:07.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.160+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:44:07.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 141 16 1811895 1811879 803.063 811.688 0.00101335 0.00123337 2024-09-16T03:44:07.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.164+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:44:07.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.176+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:44:07.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.196+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:44:07.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:44:07.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:44:07.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:44:07.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.228+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:44:07.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.240+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:44:07.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.260+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:44:07.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.284+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:44:07.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.288+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:07.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.324+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:44:07.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.344+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:44:07.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.360+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:07.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:07.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.376+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:44:07.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.380+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:44:07.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.392+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:44:07.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.400+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:44:07.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:44:07.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:07.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:07.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.464+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:44:07.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.480+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:07.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.492+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:07.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:44:07.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.512+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:44:07.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.516+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:44:07.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:07.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.540+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:44:07.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.584+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:07.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.588+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:44:07.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.600+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:44:07.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.604+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:44:07.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:07.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:07.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.620+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:07.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.648+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:07.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.652+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:44:07.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.660+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:07.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.668+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:44:07.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.680+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:44:07.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.696+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:44:07.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.700+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:07.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.704+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:44:07.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:44:07.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:44:07.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.824+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:07.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.824+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:44:07.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.836+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:44:07.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.868+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:44:07.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:44:07.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.908+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:44:07.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:07.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:07.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:44:07.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.936+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:44:07.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.956+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:44:07.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.960+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:07.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:44:07.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:44:07.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:08.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:07.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:08.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.000+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:44:08.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:44:08.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:44:08.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.044+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:44:08.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.076+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:08.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.080+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:08.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.088+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:44:08.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.092+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:44:08.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.104+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:08.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.112+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:08.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.116+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:44:08.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.132+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:44:08.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 142 16 1823856 1823840 802.672 747.562 0.000762308 0.00123398 2024-09-16T03:44:08.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.180+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:08.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:44:08.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.184+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:44:08.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.196+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:08.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:08.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.216+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:44:08.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.224+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:44:08.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.232+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:08.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:08.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.264+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:44:08.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.276+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:44:08.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:08.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:08.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.292+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:44:08.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.316+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:08.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.320+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:44:08.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.324+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:08.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:08.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.352+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:44:08.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.352+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:44:08.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.372+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:08.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.376+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:44:08.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.376+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:08.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.428+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:44:08.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.428+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:08.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.444+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:08.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.460+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:08.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.460+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:44:08.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.492+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:08.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.504+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:44:08.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.512+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:08.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.520+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:44:08.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:44:08.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:08.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.560+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:44:08.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:44:08.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.584+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:44:08.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:08.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.608+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:44:08.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.628+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:08.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.632+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:44:08.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:44:08.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:08.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.664+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:08.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.664+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:44:08.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.668+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:44:08.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:44:08.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.688+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:44:08.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.724+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:44:08.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.744+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:44:08.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.760+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:44:08.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.780+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:44:08.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.780+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:44:08.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:44:08.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.800+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:44:08.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.808+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:44:08.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.812+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:44:08.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.816+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:44:08.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.848+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:44:08.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.856+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:44:08.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.860+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:08.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.896+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:08.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.904+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:44:08.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.904+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:08.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.904+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:44:08.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.928+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:44:08.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.928+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:08.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.940+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:44:08.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.940+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:08.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.980+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:44:08.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:08.980+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:09.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.012+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:09.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.012+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:09.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:09.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.052+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:44:09.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.064+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:44:09.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.080+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:09.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.080+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:09.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.088+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:44:09.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.092+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:09.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.100+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:09.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.104+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:44:09.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.116+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:44:09.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:44:09.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.148+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:44:09.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.160+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:09.167 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 143 16 1837106 1837090 802.849 828.125 0.000669175 0.0012337 2024-09-16T03:44:09.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.164+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:44:09.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.164+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:44:09.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:44:09.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.212+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:44:09.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.224+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:09.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.228+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:44:09.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.232+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:09.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:09.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.248+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:44:09.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:09.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.288+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:44:09.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:09.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.296+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:09.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.300+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:44:09.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.328+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:44:09.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.332+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:44:09.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.336+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:44:09.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.348+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:44:09.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.360+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:44:09.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.376+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:44:09.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.380+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:09.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.396+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:09.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.400+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:44:09.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.400+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:44:09.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.424+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:44:09.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.436+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:09.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.440+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:09.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:44:09.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.464+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:09.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.468+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:44:09.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.476+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:44:09.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.500+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:44:09.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:44:09.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:44:09.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.508+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:09.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:09.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.548+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:09.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.552+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:09.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.560+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:09.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.572+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:44:09.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.596+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:44:09.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:09.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.632+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:44:09.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.640+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:44:09.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.644+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:44:09.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.668+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:44:09.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.672+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:44:09.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.708+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:44:09.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:44:09.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.728+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:09.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:44:09.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:44:09.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.772+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:09.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.788+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:44:09.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:09.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.812+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:44:09.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.816+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:44:09.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:09.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.860+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:09.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.876+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:44:09.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.880+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:44:09.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.888+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:44:09.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.900+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:44:09.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.912+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:44:09.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:09.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.948+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:09.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:44:09.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:09.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:09.980+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:44:10.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.000+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:10.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.004+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:44:10.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.016+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:44:10.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.032+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:10.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:44:10.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.040+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:10.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.056+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:10.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.072+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:44:10.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:44:10.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:44:10.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.112+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:44:10.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:44:10.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.128+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:10.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.128+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:10.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.152+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:44:10.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 144 16 1850320 1850304 803.009 825.875 0.00165521 0.00123345 2024-09-16T03:44:10.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.168+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:10.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.188+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:44:10.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.204+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:44:10.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.216+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:44:10.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.220+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:44:10.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.244+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:44:10.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.252+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:44:10.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.256+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:10.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.268+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:44:10.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.268+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:10.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.284+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:44:10.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.300+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:10.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.308+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:44:10.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.312+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:44:10.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.324+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:10.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.336+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:44:10.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:44:10.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.356+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:44:10.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:44:10.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.368+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:10.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.392+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:44:10.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.404+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:10.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:44:10.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.428+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:44:10.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:10.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.444+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:44:10.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.452+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:44:10.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.468+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:44:10.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.480+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:44:10.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.480+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:44:10.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.484+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:10.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.496+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:44:10.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:44:10.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.520+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:44:10.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:44:10.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.544+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:44:10.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.552+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:44:10.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.552+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:10.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:44:10.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.580+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:44:10.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.604+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:10.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.608+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:44:10.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:44:10.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.628+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:10.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.632+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:44:10.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.652+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:44:10.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.668+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:44:10.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:44:10.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.696+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:10.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.696+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:44:10.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.704+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:44:10.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.740+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:44:10.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.756+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:44:10.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.764+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:44:10.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.768+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:10.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.772+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:44:10.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.784+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:10.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.800+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:10.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.804+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:44:10.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.812+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:44:10.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.812+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:44:10.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:44:10.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.824+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:44:10.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:10.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.868+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:44:10.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.884+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:10.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:44:10.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.904+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:44:10.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:44:10.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.920+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:44:10.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.924+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:10.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.928+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:10.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.956+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:44:10.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:10.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:44:10.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.980+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:10.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:10.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:44:11.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:11.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.024+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:11.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.024+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:44:11.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.032+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:44:11.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:44:11.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:11.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.072+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:11.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.076+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:44:11.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.088+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:11.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.116+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:44:11.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.124+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:44:11.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.124+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:44:11.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.152+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:11.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.152+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:44:11.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.160+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:44:11.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 145 15 1863178 1863163 803.013 803.688 0.000727055 0.00123344 2024-09-16T03:44:11.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.164+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:44:11.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.168+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:44:11.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:11.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.196+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:44:11.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.212+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:44:11.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.232+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:44:11.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.232+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:44:11.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.236+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:11.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.244+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:11.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.252+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:11.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.272+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:44:11.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:44:11.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.280+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:44:11.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.292+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:11.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.292+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:44:11.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.296+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:44:11.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.324+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:11.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.336+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:44:11.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:44:11.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.356+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:11.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:11.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.372+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:44:11.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.384+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:44:11.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.388+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:44:11.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.396+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:44:11.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.404+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:44:11.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.424+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:44:11.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:11.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.444+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:11.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.456+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:11.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.456+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:44:11.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.468+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:11.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:44:11.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.500+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:44:11.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.504+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:44:11.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.524+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:44:11.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.528+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:11.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.528+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:11.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.532+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:44:11.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:44:11.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.560+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:44:11.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.588+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:44:11.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.604+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:11.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.612+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:44:11.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.620+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:44:11.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.640+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:44:11.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.648+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:44:11.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.652+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:11.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.668+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:44:11.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.676+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:11.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.684+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:11.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:44:11.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.696+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:11.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.708+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:44:11.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.728+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:44:11.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.740+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:11.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.748+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:44:11.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:44:11.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.752+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:11.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.764+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:11.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.776+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:44:11.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:44:11.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.804+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:11.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.816+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:44:11.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:11.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.836+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:44:11.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.836+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:44:11.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.860+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:44:11.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.864+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:44:11.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.872+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:44:11.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.876+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:44:11.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.900+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:44:11.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:44:11.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.920+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:44:11.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.924+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:44:11.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.928+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:44:11.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.940+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:44:11.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.968+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:44:11.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:44:11.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:11.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:11.992+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:44:12.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.000+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:12.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.004+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:44:12.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.004+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:44:12.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.012+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:12.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:44:12.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.052+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:44:12.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.052+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:44:12.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:12.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.092+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:44:12.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.096+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:44:12.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.100+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:12.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.108+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:44:12.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:12.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.136+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:12.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.136+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:44:12.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.156+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:44:12.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 146 16 1875716 1875700 802.879 783.562 0.00215461 0.00123364 2024-09-16T03:44:12.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.172+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:12.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.180+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:12.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.196+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:44:12.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.196+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:44:12.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.200+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:44:12.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:44:12.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.228+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:44:12.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.232+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:44:12.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:44:12.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.280+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:44:12.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:44:12.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:44:12.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.328+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:12.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.332+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:12.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:44:12.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:44:12.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:44:12.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:44:12.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.368+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:44:12.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.396+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:44:12.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.416+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:44:12.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.428+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:44:12.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:44:12.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.472+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:44:12.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.476+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:44:12.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.488+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:44:12.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.504+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:44:12.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:12.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:12.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.532+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:44:12.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.540+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:12.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:12.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.556+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:44:12.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.568+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:44:12.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:44:12.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:12.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.600+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:44:12.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.604+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:44:12.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.624+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:44:12.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:44:12.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.636+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:44:12.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.676+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:44:12.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.704+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:12.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.708+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:12.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.716+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:44:12.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.732+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:44:12.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.736+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:44:12.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.760+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:12.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.772+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:44:12.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.776+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:12.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.792+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:44:12.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:44:12.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:44:12.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.800+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:12.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.812+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:12.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.820+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:44:12.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.828+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:44:12.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.836+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:12.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.860+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:12.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.868+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:44:12.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.876+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:44:12.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.884+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:44:12.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.884+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:44:12.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.912+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:44:12.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.916+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:44:12.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.916+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:12.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.928+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:12.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.948+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:12.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.948+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:44:12.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.968+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:44:12.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.984+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:12.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.988+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:44:13.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:12.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:44:13.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.028+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:44:13.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:44:13.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.052+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:13.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.064+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:13.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.068+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:44:13.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.084+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:13.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.092+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:44:13.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.096+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:13.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.100+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:44:13.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.108+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:44:13.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.116+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:13.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:44:13.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.140+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:13.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.152+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:13.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 147 16 1888852 1888836 803.002 821 0.000683584 0.00123345 2024-09-16T03:44:13.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.168+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:44:13.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.184+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:44:13.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.184+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:13.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.200+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:44:13.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.216+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:44:13.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:44:13.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.228+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:44:13.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.232+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:44:13.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.244+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:13.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.244+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:44:13.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:44:13.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:13.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.280+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:44:13.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.300+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:13.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.312+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:13.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:44:13.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:44:13.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.332+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:13.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:13.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.368+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:44:13.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.384+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:44:13.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.392+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:44:13.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:44:13.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.412+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:44:13.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.424+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:44:13.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.432+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:13.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.448+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:44:13.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.456+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:44:13.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:44:13.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.468+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:44:13.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:44:13.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:44:13.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.496+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:13.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.544+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:44:13.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.548+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:13.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:44:13.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.576+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:44:13.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.604+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:13.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.620+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:13.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.620+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:44:13.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:44:13.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.640+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:13.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.652+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:13.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.656+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:13.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.676+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:44:13.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.700+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:44:13.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:13.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.704+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:13.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.712+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:44:13.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:44:13.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:44:13.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.768+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:44:13.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.768+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:13.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.772+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:44:13.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.784+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:44:13.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.788+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:13.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:13.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.808+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:13.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.824+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:44:13.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.828+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:13.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:44:13.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:44:13.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:44:13.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:44:13.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.884+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:44:13.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.904+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:44:13.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.920+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:13.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.932+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:13.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.936+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:44:13.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:44:13.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:44:13.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.952+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:13.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.972+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:44:13.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.976+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:44:13.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:44:13.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:13.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:44:14.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.004+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:14.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.036+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:14.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.044+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:14.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.052+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:14.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:44:14.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.100+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:44:14.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.100+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:14.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.108+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:44:14.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.120+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:14.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.128+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:44:14.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.136+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:44:14.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.140+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:44:14.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.164+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:14.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 148 16 1902072 1902056 803.159 826.25 0.000848869 0.00123321 2024-09-16T03:44:14.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.172+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:44:14.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.176+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:44:14.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.196+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:44:14.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.196+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:44:14.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.212+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:14.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.248+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:14.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.256+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:44:14.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.260+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:14.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:14.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.288+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:44:14.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:14.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.312+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:44:14.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.320+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:44:14.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.328+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:14.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.336+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:44:14.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.352+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:44:14.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:14.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.364+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:44:14.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.368+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:14.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.372+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:44:14.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.384+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:44:14.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.392+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:14.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.404+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:44:14.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.408+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:44:14.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.440+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:44:14.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.444+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:44:14.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.448+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:44:14.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:44:14.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:44:14.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.524+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:44:14.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.540+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:44:14.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:44:14.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.568+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:44:14.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.580+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:44:14.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:44:14.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.596+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:44:14.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.612+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:44:14.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.620+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:14.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:44:14.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.640+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:44:14.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:44:14.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.664+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:44:14.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.672+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:44:14.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.676+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:44:14.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.680+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:44:14.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.688+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:14.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.712+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:14.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.716+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:44:14.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.724+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:14.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.728+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:14.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.740+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:44:14.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:14.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.752+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:14.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.756+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:44:14.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.792+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:44:14.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.796+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:14.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:44:14.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.812+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:14.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:44:14.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.836+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:44:14.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.840+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:44:14.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.864+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:14.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.876+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:14.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.876+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:44:14.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.892+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:44:14.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.900+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:14.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.904+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:14.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.924+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:14.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.932+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:44:14.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.936+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:44:14.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:44:14.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.952+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:44:14.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:44:14.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:14.980+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:44:15.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:44:15.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.000+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:44:15.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.016+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:44:15.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.024+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:44:15.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.036+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:44:15.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.060+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:15.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.084+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:15.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.092+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:44:15.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.092+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:15.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.116+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:44:15.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.120+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:44:15.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.148+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:15.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.148+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:44:15.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.148+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:44:15.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 149 15 1914957 1914942 803.173 805.375 0.000731073 0.00123319 2024-09-16T03:44:15.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.164+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:15.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:44:15.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.176+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:44:15.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.180+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:15.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.216+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:15.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.216+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:44:15.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.224+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:44:15.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:44:15.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.276+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:44:15.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:44:15.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.292+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:44:15.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.292+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:44:15.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:44:15.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:44:15.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.312+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:15.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.324+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:44:15.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.352+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:44:15.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.380+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:44:15.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.384+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:44:15.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.392+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:44:15.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.396+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:44:15.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.404+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:15.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.412+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:44:15.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.424+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:44:15.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:44:15.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.460+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:44:15.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.468+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:44:15.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.476+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:44:15.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.480+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:44:15.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.520+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:44:15.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.524+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:44:15.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.536+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:44:15.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.540+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:44:15.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:44:15.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.560+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:44:15.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.560+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:44:15.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.564+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:44:15.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.588+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:44:15.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.588+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:44:15.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.600+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:44:15.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.616+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:44:15.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.624+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:44:15.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.636+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:44:15.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.648+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:44:15.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:15.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.656+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:15.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.664+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:44:15.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.684+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:44:15.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.704+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:44:15.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.712+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:15.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.724+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:44:15.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.744+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:44:15.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:44:15.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.776+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:44:15.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.784+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:44:15.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.796+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:44:15.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.800+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:44:15.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.812+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:44:15.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.824+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:44:15.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.832+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:44:15.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:15.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.840+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:15.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.864+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:44:15.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:44:15.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.892+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:15.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.896+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:44:15.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.900+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:44:15.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.916+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:15.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.916+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:15.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.924+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:44:15.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.952+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:44:15.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.960+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:44:15.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:44:15.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:44:15.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:15.988+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:44:16.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.004+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:16.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.012+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:44:16.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.016+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:44:16.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.016+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:16.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.028+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:44:16.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.040+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:16.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.040+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:16.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:44:16.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.096+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:16.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.104+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:44:16.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:44:16.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.144+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:16.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 150 16 1928401 1928385 803.419 840.188 0.000674844 0.00123282 2024-09-16T03:44:16.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.172+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:44:16.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.176+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:44:16.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:16.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.224+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:44:16.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:44:16.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:16.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:16.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.308+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:44:16.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.312+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:16.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.328+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:16.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:16.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.344+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:44:16.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.352+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:44:16.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.376+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:16.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.388+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:44:16.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.396+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:16.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.400+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:16.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.404+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:44:16.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:16.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.432+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:44:16.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:44:16.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.468+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:44:16.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.480+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:44:16.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.488+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:44:16.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.492+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:16.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.500+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:16.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.520+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:16.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.528+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:16.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.536+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:44:16.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.544+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:16.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:44:16.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.572+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:44:16.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:16.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:44:16.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.596+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:44:16.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.604+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:44:16.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:16.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:16.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.632+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:16.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.648+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:44:16.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.664+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:44:16.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.680+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:44:16.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.680+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:44:16.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.700+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:16.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:16.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:44:16.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.752+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:44:16.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:44:16.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.756+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:44:16.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.756+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:44:16.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:44:16.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.792+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:44:16.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.808+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:44:16.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.812+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:44:16.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.816+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:44:16.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.832+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:16.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:16.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.840+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:16.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:44:16.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.880+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:16.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.884+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:16.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:44:16.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.900+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:44:16.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.940+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:16.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.944+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:44:16.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.968+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:16.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:16.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:16.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:17.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.000+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:44:17.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.000+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:44:17.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.008+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:17.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.016+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:44:17.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:44:17.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.036+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:17.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.044+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:44:17.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.044+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:17.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:44:17.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.060+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:17.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.072+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:44:17.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:17.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:44:17.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.084+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:17.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.104+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:17.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.108+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:44:17.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.136+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:44:17.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.136+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:44:17.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.144+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:17.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.152+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:17.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 151 15 1941481 1941466 803.512 817.562 0.000663405 0.00123264 2024-09-16T03:44:17.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:17.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.192+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:17.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.200+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:17.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.204+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:44:17.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:44:17.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:44:17.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.244+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:44:17.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.264+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:44:17.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:17.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:17.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.304+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:17.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.312+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:17.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:44:17.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:17.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:44:17.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.356+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:17.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.364+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:44:17.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.376+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:17.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.404+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:44:17.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:17.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.420+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:44:17.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:44:17.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.452+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:17.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.456+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:17.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.460+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:17.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.480+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:44:17.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.488+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:44:17.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.504+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:44:17.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.520+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:44:17.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.532+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:17.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.532+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:44:17.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.536+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:44:17.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:44:17.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.560+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:17.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.568+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:17.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:44:17.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:44:17.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.604+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:17.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.628+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:44:17.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:44:17.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.644+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:17.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.652+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:44:17.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.680+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:44:17.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.688+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:44:17.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.700+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:17.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.704+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:44:17.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.720+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:44:17.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:17.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.744+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:44:17.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.748+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:44:17.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:44:17.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.756+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:17.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.756+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:44:17.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.800+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:17.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:17.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.808+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:17.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.820+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:44:17.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.828+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:44:17.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.832+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:44:17.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:17.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.868+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:44:17.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.868+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:17.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.868+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:44:17.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.892+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:44:17.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.908+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:17.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.912+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:44:17.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.912+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:17.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.932+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:44:17.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.948+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:44:17.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.952+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:44:17.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.968+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:17.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.972+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:17.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.988+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:17.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:17.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:18.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.004+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:18.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.020+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:44:18.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:44:18.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.044+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:44:18.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.044+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:44:18.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.060+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:18.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.060+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:18.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:18.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.068+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:44:18.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.076+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:18.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.112+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:44:18.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.116+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:44:18.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.140+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:44:18.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.144+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:44:18.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.144+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:18.168 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 152 16 1954738 1954722 803.676 828.5 0.00110842 0.00123242 2024-09-16T03:44:18.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.184+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:44:18.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.228+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:44:18.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:18.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.236+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:44:18.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.248+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:44:18.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.256+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:44:18.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.256+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:18.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.284+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:18.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.284+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:44:18.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.300+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:44:18.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.312+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:44:18.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.320+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:18.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.324+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:18.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.344+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:44:18.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.344+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:44:18.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.352+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:44:18.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.360+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:18.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.380+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:44:18.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.384+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:44:18.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:44:18.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.412+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:18.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.416+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:44:18.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:44:18.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:18.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.444+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:44:18.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.456+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:44:18.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.464+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:44:18.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.488+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:18.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.488+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:44:18.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.504+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:44:18.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.508+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:18.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:44:18.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.540+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:18.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:44:18.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.568+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:18.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.584+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:44:18.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:44:18.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.628+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:44:18.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.636+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:18.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.640+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:44:18.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:44:18.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.652+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:44:18.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.656+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:18.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.672+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:44:18.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.692+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:44:18.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:18.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.712+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:44:18.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.728+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:44:18.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.732+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:18.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.748+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:44:18.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.760+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:18.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:18.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.784+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:44:18.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.784+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:44:18.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.808+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:44:18.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.836+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:44:18.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.836+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:44:18.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.844+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:44:18.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.860+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:44:18.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:44:18.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.864+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:18.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.888+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:18.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:18.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.888+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:18.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.904+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:44:18.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.916+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:44:18.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.916+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:18.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.948+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:44:18.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:18.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.956+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:18.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:44:18.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:44:18.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:18.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.984+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:44:18.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:18.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:44:19.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.008+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:44:19.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:44:19.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.028+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:44:19.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.032+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:44:19.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.052+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:19.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.064+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:44:19.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:19.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.084+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:19.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.088+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:44:19.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.116+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:44:19.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.128+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:44:19.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.132+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:44:19.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.136+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:44:19.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.152+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:19.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.152+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:44:19.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 153 16 1967350 1967334 803.574 788.25 0.0011471 0.00123256 2024-09-16T03:44:19.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:44:19.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:19.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.200+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:44:19.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.232+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:19.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:44:19.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.252+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:19.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.276+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:19.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.284+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:44:19.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.284+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:44:19.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:44:19.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.296+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:44:19.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.300+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:44:19.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.308+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:44:19.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:44:19.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.332+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:19.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:44:19.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.344+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:44:19.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.352+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:19.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.360+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:44:19.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:44:19.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.376+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:44:19.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.388+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:19.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.396+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:44:19.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.416+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:44:19.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.452+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:44:19.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.452+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:44:19.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:44:19.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.504+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:44:19.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.504+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:19.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.512+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:44:19.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.536+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:19.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.540+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:44:19.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.544+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:44:19.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.568+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:44:19.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.592+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:19.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.608+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:44:19.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:44:19.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.620+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:44:19.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.624+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:44:19.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:44:19.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.640+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:44:19.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.720+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:44:19.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.724+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:19.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.776+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:44:19.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:19.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.804+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:44:19.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.812+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:19.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.816+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:44:19.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.820+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:44:19.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.836+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:44:19.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.848+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:44:19.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.864+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:44:19.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.872+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:19.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.876+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:44:19.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.900+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:19.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.904+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:19.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.932+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:44:19.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.932+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:44:19.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:19.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.944+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:44:19.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.948+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:19.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.968+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:19.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.984+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:20.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:19.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:44:20.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:20.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.024+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:44:20.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:20.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.036+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:20.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.044+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:44:20.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.048+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:20.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.080+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:20.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.096+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:44:20.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.096+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:44:20.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.132+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:44:20.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.148+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:20.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.152+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:44:20.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 154 16 1979196 1979180 803.163 740.375 0.00157975 0.00123321 2024-09-16T03:44:20.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.168+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:20.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.180+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:44:20.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:20.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:44:20.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.212+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:20.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.220+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:44:20.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.236+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:44:20.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:20.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.244+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:44:20.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:44:20.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.304+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:44:20.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.308+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:20.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.312+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:44:20.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.348+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:20.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.356+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:44:20.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.356+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:20.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:44:20.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.392+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:44:20.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.396+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:20.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.432+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:44:20.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.452+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:44:20.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.472+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:44:20.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:44:20.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.476+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:44:20.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.488+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:44:20.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.504+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:44:20.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.528+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:44:20.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:44:20.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.560+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:20.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.560+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:44:20.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.612+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:44:20.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.616+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:44:20.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.628+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:44:20.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:44:20.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.640+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:44:20.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.660+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:44:20.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.664+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:20.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.668+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:44:20.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.668+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:44:20.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.692+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:44:20.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:44:20.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.724+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:20.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.728+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:20.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.728+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:20.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.752+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:44:20.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.768+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:44:20.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.772+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:44:20.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.784+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:44:20.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.784+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:44:20.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.792+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:44:20.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:44:20.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.836+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:44:20.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.836+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:20.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.840+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:44:20.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:20.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.860+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:44:20.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.884+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:20.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:44:20.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.904+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:20.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.908+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:44:20.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.920+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:20.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.952+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:44:20.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.964+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:44:20.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.972+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:44:20.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:20.988+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:44:21.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:44:21.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.000+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:21.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:21.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:44:21.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.020+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:44:21.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.028+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:44:21.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.036+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:21.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.060+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:44:21.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.072+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:44:21.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.084+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:21.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:44:21.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.092+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:44:21.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.108+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:44:21.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.108+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:44:21.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.152+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:44:21.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 155 16 1992320 1992304 803.273 820.25 0.000841446 0.00123305 2024-09-16T03:44:21.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.164+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:44:21.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.176+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:44:21.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:21.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.184+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:21.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.192+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:44:21.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.212+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:44:21.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.220+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:44:21.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.224+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:21.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.224+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:44:21.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.232+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:44:21.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.256+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:44:21.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.276+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:21.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:21.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.308+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:44:21.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.312+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:44:21.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:44:21.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.336+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:44:21.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:21.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:21.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.360+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:44:21.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.364+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:44:21.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.372+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:21.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.396+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:44:21.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.412+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:44:21.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.416+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:44:21.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:21.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.472+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:44:21.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.484+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:44:21.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.484+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:44:21.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:44:21.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.488+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:21.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.500+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:44:21.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.504+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:21.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.528+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:44:21.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.536+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:21.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.552+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:44:21.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.560+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:21.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.568+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:21.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.580+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:44:21.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.600+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:44:21.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.616+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:21.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.624+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:44:21.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.636+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:21.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:44:21.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:44:21.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.656+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:44:21.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.664+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:21.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.696+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:44:21.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.700+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:44:21.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.704+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:21.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.704+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:44:21.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.720+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:44:21.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.740+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:44:21.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.740+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:44:21.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.752+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:21.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.756+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:44:21.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.788+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:44:21.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.796+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:44:21.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.824+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:21.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.828+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:44:21.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.828+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:44:21.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.856+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:21.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.860+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:21.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.880+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:44:21.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.888+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:21.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:44:21.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.888+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:21.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.904+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:44:21.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.936+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:21.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:44:21.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.944+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:21.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:44:21.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.952+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:21.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.984+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:44:21.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.992+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:44:21.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.992+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:44:22.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.996+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:44:22.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:21.996+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:44:22.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.016+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:44:22.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.068+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:44:22.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.084+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:22.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.096+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:44:22.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.124+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:44:22.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:44:22.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.160+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:22.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 156 16 2005160 2005144 803.268 802.5 0.000825946 0.00123306 2024-09-16T03:44:22.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.168+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:44:22.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.176+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:44:22.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.176+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:22.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.184+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:44:22.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.192+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:22.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.212+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:44:22.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.240+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:44:22.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:22.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:44:22.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.284+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:22.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.292+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:44:22.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.308+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:22.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.320+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:44:22.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.328+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:22.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.332+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:22.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.340+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:44:22.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:44:22.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.356+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:44:22.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.376+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:44:22.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.396+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:44:22.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.412+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:44:22.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.416+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:44:22.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.428+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:22.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:44:22.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.448+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:22.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.464+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:44:22.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.476+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:44:22.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.476+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:44:22.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.496+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:22.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.520+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:44:22.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:22.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.552+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:22.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.580+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:44:22.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.592+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:22.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:44:22.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.596+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:22.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:44:22.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.636+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:44:22.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.636+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:44:22.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:22.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:44:22.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.676+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:44:22.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.676+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:44:22.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.680+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:22.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.684+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:22.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:44:22.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.736+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:22.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.748+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:44:22.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.760+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:22.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.776+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:44:22.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.780+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:44:22.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:44:22.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.828+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:44:22.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.840+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:22.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.840+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:44:22.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.860+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:44:22.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.864+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:22.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:44:22.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.896+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:22.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.900+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:44:22.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.912+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:22.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.916+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:44:22.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.932+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:44:22.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:44:22.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:22.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.960+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:44:22.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.964+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:44:22.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.976+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:22.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:22.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:44:23.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:23.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.004+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:44:23.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.020+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:44:23.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:44:23.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.024+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:44:23.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.044+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:44:23.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:44:23.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.060+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:23.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.076+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:23.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.084+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:44:23.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.088+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:44:23.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.116+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:23.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.120+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:44:23.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.120+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:44:23.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:44:23.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:23.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:44:23.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 157 16 2018292 2018276 803.379 820.75 0.00103341 0.00123288 2024-09-16T03:44:23.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:44:23.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.184+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:44:23.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:23.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.208+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:44:23.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.224+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:23.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.224+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:44:23.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:44:23.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.272+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:44:23.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.280+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:44:23.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.288+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:44:23.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:23.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.308+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:44:23.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.312+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:44:23.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.312+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:23.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.328+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:23.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.348+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:44:23.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.352+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:44:23.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.368+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:44:23.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.376+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:44:23.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.384+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:44:23.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.388+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:23.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:44:23.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:44:23.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.432+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:23.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.444+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:23.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.448+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:44:23.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.456+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:23.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.464+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:44:23.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:44:23.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.484+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:44:23.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:44:23.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.508+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:44:23.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.512+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:23.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.512+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:23.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.544+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:23.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:44:23.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.576+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:44:23.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.584+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:44:23.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.592+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:23.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.612+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:44:23.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.616+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:44:23.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.616+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:23.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.620+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:44:23.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.676+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:44:23.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.680+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:23.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.680+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:44:23.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:44:23.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.700+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:44:23.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.716+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:44:23.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:44:23.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.724+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:44:23.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.740+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:44:23.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.760+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:44:23.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.760+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:44:23.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.768+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:44:23.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.772+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:23.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.792+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:44:23.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.800+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:44:23.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.816+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:23.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.820+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:44:23.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.824+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:44:23.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.832+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:44:23.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.852+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:44:23.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.864+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:44:23.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.872+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:44:23.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:44:23.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.888+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:44:23.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.892+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:23.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.924+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:44:23.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:44:23.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.940+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:44:23.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.944+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:44:23.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.948+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:44:23.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.976+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:44:23.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.976+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:44:23.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:44:24.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:23.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:44:24.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.004+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:44:24.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.008+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:44:24.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.012+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:44:24.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.016+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:44:24.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.052+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:24.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.060+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:44:24.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:44:24.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.068+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:44:24.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.076+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:24.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.080+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:24.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.092+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:44:24.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.104+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:24.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.112+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:24.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:24.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:24.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.148+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:44:24.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:44:24.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.156+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:44:24.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.156+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:44:24.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 158 15 2030813 2030798 803.247 782.625 0.0006868 0.00123306 2024-09-16T03:44:24.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.172+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:24.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.172+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:44:24.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:44:24.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.200+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:24.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.208+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:44:24.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.244+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:24.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.260+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:24.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.268+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:44:24.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:44:24.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.272+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:24.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.272+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:44:24.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.304+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:44:24.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.312+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:44:24.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:24.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.336+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:44:24.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.344+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:44:24.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.352+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:44:24.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.364+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:44:24.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.388+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:24.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.420+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:44:24.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.424+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:24.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.440+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:24.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.448+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:44:24.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.472+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:44:24.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.476+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:44:24.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:24.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:24.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.524+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:24.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.528+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:24.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.552+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:24.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.564+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:44:24.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:44:24.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:24.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.616+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:44:24.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.632+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:44:24.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:44:24.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:24.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.696+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:44:24.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.700+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:44:24.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.736+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:44:24.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.756+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:44:24.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.768+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:44:24.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.772+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:44:24.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.776+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:44:24.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.796+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:24.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.808+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:44:24.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.816+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:44:24.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.828+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:24.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:24.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.844+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:44:24.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.852+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:24.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:24.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.880+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:24.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:44:24.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.888+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:24.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.900+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:44:24.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.936+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:44:24.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.936+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:44:24.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.972+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:44:24.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.972+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:24.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:24.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.976+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:44:25.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:24.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:25.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:44:25.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.008+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:44:25.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.028+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:44:25.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:44:25.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.052+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:44:25.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:44:25.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:44:25.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.084+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:44:25.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.084+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:25.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.100+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:44:25.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.100+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:25.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:25.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.124+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:44:25.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.140+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:25.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:25.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.152+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:25.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.160+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:44:25.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 159 16 2043549 2043533 803.2 795.938 0.00167612 0.00123314 2024-09-16T03:44:25.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.172+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:44:25.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.180+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:44:25.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.196+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:25.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.228+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:44:25.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.232+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:44:25.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.240+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:44:25.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:44:25.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:25.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:44:25.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.304+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:44:25.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.308+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:44:25.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.312+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:44:25.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.316+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:44:25.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.344+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:25.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.344+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:25.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.344+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:44:25.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.352+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:44:25.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:44:25.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.372+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:44:25.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.384+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:25.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.404+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:25.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:44:25.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:44:25.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:44:25.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.480+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:25.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:44:25.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.508+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:44:25.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.516+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:44:25.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.528+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:25.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.532+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:44:25.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.556+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:44:25.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.572+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:25.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:44:25.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:44:25.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:44:25.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.600+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:25.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.616+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:25.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.620+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:25.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:25.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.632+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:44:25.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.664+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:44:25.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.680+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:25.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:44:25.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.688+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:44:25.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.688+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:44:25.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.696+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:44:25.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.708+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:44:25.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.716+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:44:25.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:44:25.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.744+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:25.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.752+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:44:25.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.764+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:44:25.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.780+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:25.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.812+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:44:25.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:44:25.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.820+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:44:25.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.820+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:25.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.852+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:44:25.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.852+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:44:25.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.860+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:44:25.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:44:25.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.876+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:25.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.888+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:44:25.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:25.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:44:25.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.912+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:25.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.928+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:44:25.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.936+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:44:25.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.940+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:25.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:25.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.948+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:44:25.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.960+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:44:25.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:44:25.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:25.988+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:44:26.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.000+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:26.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.016+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:26.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:26.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.060+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:44:26.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:44:26.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.076+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:44:26.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:26.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.092+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:44:26.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:44:26.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.128+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:44:26.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.128+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:26.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.160+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:44:26.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.164+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:44:26.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:44:26.169333+0000 min lat: 0.000234761 max lat: 0.129137 avg lat: 0.00123311 2024-09-16T03:44:26.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:44:26.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 160 15 2056490 2056475 803.235 808.875 0.000731719 0.00123311 2024-09-16T03:44:26.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.164+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:44:26.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.172+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:44:26.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.180+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:44:26.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.184+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:26.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.224+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:44:26.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.232+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:44:26.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:26.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.256+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:44:26.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.292+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:44:26.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:26.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:44:26.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.352+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:26.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:44:26.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.376+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:26.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.396+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:44:26.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:44:26.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.440+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:44:26.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:26.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:44:26.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:44:26.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.476+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:44:26.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:44:26.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.484+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:26.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.484+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:26.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.496+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:26.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.504+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:26.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:26.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.536+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:26.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.552+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:44:26.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.564+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:44:26.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.584+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:26.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.592+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:26.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.596+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:44:26.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.604+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:26.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.616+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:44:26.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:44:26.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:26.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.660+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:26.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.680+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:44:26.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.680+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:26.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.688+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:44:26.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.692+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:44:26.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.732+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:26.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.744+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:26.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:44:26.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.752+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:44:26.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.764+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:44:26.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.776+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:44:26.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.780+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:26.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.812+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:26.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.816+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:44:26.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.828+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:44:26.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:44:26.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.852+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:26.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.856+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:26.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:44:26.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.864+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:44:26.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.872+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:44:26.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.880+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:44:26.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:44:26.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:44:26.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.928+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:44:26.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.928+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:44:26.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.936+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:44:26.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.956+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:26.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.956+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:44:26.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.968+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:44:26.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.980+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:44:26.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.980+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:26.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:26.988+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:44:27.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.020+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:44:27.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.028+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:27.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.048+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:44:27.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.072+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:27.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.084+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:27.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.096+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:27.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.100+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:27.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.104+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:44:27.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.104+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:44:27.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.144+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:44:27.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:44:27.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.156+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:44:27.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.164+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:44:27.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 161 15 2069380 2069365 803.25 805.625 0.000725792 0.00123309 2024-09-16T03:44:27.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.176+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:44:27.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.208+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:44:27.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.220+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:44:27.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.224+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:27.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.228+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:27.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:44:27.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.256+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:44:27.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.260+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:27.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.284+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:44:27.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:44:27.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.308+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:44:27.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.320+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:44:27.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.352+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:44:27.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.364+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:44:27.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:27.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.372+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:44:27.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.392+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:44:27.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:44:27.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.448+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:44:27.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.448+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:27.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.452+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:44:27.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.480+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:44:27.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:44:27.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.492+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:27.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.516+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:27.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.532+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:44:27.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.536+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:27.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.540+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:44:27.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:44:27.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:44:27.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.584+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:44:27.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.592+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:44:27.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.596+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:44:27.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:44:27.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.660+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:44:27.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.676+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:44:27.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.684+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:44:27.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.692+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:44:27.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.712+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:44:27.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.716+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:44:27.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.736+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:44:27.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.736+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:44:27.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.752+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:44:27.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.764+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:44:27.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:44:27.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:27.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.788+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:27.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.788+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:27.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:44:27.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.808+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:27.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:44:27.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.848+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:44:27.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.856+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:44:27.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.864+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:44:27.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.884+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:44:27.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.896+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:44:27.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.908+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:27.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.916+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:27.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.932+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:44:27.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.936+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:44:27.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.944+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:44:27.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.956+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:44:27.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:44:27.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.968+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:27.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:27.992+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:44:28.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:44:28.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:44:28.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.020+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:44:28.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:28.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.036+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:44:28.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.036+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:44:28.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.056+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:44:28.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.064+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:44:28.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:44:28.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.108+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:44:28.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.108+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:44:28.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.108+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:44:28.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:28.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.140+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:44:28.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.152+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:28.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 162 15 2082533 2082518 803.366 822.062 0.000605334 0.0012329 2024-09-16T03:44:28.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.184+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:44:28.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.196+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:44:28.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:44:28.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.200+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:44:28.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.216+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:44:28.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.228+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:44:28.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:44:28.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.284+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:28.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.284+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:28.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.300+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:44:28.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.300+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:44:28.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.308+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:44:28.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:44:28.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.356+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:28.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.360+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:44:28.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.364+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:28.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.372+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:28.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.376+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:28.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.400+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:44:28.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.420+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:28.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.424+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:44:28.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.428+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:44:28.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.480+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:28.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.484+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:28.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.504+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:28.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:44:28.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.552+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:44:28.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.556+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:44:28.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.560+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:44:28.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.568+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:28.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.572+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:44:28.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.596+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:28.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.620+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:28.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:44:28.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.632+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:44:28.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.644+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:44:28.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.648+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:28.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.656+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:44:28.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.680+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:44:28.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.708+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:44:28.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.728+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:44:28.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.732+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:44:28.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.744+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:44:28.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:28.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:44:28.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.768+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:44:28.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.820+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:44:28.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.828+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:44:28.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.860+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:44:28.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.860+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:28.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:44:28.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:44:28.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.896+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:28.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.904+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:44:28.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.912+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:44:28.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.916+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:44:28.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.916+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:44:28.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:44:28.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:28.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.948+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:44:28.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:44:28.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.968+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:44:28.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:28.976+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:44:29.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:44:29.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.016+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:44:29.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:44:29.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.044+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:29.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.060+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:29.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:44:29.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.072+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:44:29.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.084+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:44:29.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.108+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:29.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.108+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:44:29.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:44:29.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:29.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.160+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:44:29.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 163 15 2095929 2095914 803.573 837.25 0.000771295 0.00123259 2024-09-16T03:44:29.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.172+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:44:29.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:29.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.192+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:44:29.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.196+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:29.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.200+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:29.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:29.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:29.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.252+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:44:29.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.260+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:44:29.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:44:29.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.316+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:29.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.324+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:44:29.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:29.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.348+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:44:29.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.356+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:44:29.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.360+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:44:29.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.380+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:44:29.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.404+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:44:29.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:44:29.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.420+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:44:29.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.436+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:44:29.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.436+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:44:29.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.440+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:29.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.452+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:29.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.456+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:29.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.472+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:44:29.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.476+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:29.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.504+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:44:29.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.508+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:29.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.508+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:44:29.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.524+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:44:29.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:29.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.556+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:44:29.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.568+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:29.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.584+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:44:29.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.588+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:44:29.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.592+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:29.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.596+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:44:29.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:44:29.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:44:29.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.648+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:44:29.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:44:29.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:44:29.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.732+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:29.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.752+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:29.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.772+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:44:29.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.776+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:44:29.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:29.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.812+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:29.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.812+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:44:29.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.820+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:44:29.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.844+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:44:29.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.844+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:44:29.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.864+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:29.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.868+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:44:29.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.896+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:29.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.896+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:44:29.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.920+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:44:29.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.944+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:44:29.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.960+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:29.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:44:29.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.984+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:44:29.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.988+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:44:30.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.996+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:44:30.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:29.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:44:30.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:44:30.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.028+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:30.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.040+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:44:30.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.056+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:44:30.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.068+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:44:30.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.072+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:44:30.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.080+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:44:30.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.088+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:44:30.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.120+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:44:30.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.120+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:44:30.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.124+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:30.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.144+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:30.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:30.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.160+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:30.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.160+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:44:30.169 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 164 16 2108365 2108349 803.411 777.188 0.000456504 0.00123282 2024-09-16T03:44:30.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.168+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:44:30.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.184+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:44:30.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.224+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:30.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.224+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:44:30.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.244+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:44:30.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.272+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:30.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:30.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.288+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:30.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.288+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:30.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.304+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:30.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:30.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.312+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:44:30.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.332+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:44:30.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:44:30.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.360+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:30.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.372+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:30.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:44:30.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.392+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:44:30.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.412+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:44:30.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:44:30.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.428+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:30.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:44:30.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.452+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:44:30.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.492+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:44:30.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.492+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:30.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.504+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:44:30.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.512+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:44:30.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.512+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:30.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.516+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:44:30.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.536+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:30.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:30.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.556+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:30.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.560+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:44:30.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.568+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:44:30.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.608+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:30.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:44:30.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.616+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:44:30.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.624+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:44:30.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.632+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:30.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.652+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:30.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:30.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.680+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:30.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.704+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:44:30.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.708+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:30.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.736+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:44:30.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.744+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:44:30.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.748+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:44:30.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.760+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:44:30.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.792+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:44:30.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:44:30.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.820+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:44:30.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.820+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:30.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.836+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:44:30.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.844+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:44:30.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.860+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:30.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.860+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:44:30.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.880+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:44:30.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.896+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:30.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:30.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.904+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:30.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.916+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:30.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:44:30.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.948+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:44:30.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.964+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:30.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.976+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:44:30.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.980+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:44:30.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:44:30.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:44:31.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.996+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:31.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:30.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:31.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:44:31.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.028+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:44:31.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:44:31.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.056+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:31.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.072+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:44:31.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.104+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:31.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:44:31.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.120+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:44:31.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.140+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:31.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.144+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:44:31.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 165 15 2121501 2121486 803.518 821.062 0.0023677 0.00123268 2024-09-16T03:44:31.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.168+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:31.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.168+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:31.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.180+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:44:31.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.184+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:31.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.184+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:44:31.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.200+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:44:31.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:31.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.212+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:31.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:44:31.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.228+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:31.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.264+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:44:31.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.280+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:31.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.292+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:31.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.296+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:44:31.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.304+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:31.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.312+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:31.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.320+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:31.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.364+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:44:31.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.376+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:44:31.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.392+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:44:31.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.400+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:44:31.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.404+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:44:31.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.416+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:44:31.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.432+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:31.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.432+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:31.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:44:31.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:44:31.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.472+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:44:31.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.484+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:44:31.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.500+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:44:31.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:44:31.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.528+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:31.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:31.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.532+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:44:31.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.544+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:44:31.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.548+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:31.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.556+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:31.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:44:31.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.560+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:44:31.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.592+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:31.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:44:31.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.600+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:44:31.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.604+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:44:31.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.612+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:31.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.632+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:31.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:31.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.644+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:44:31.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.672+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:44:31.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.676+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:44:31.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:44:31.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.700+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:44:31.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:44:31.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.720+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:44:31.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.728+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:44:31.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.736+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:44:31.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.748+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:31.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.752+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:44:31.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.776+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:44:31.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:31.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.800+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:31.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.800+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:44:31.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.804+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:44:31.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.820+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:31.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.840+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:44:31.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.860+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:44:31.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.876+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:31.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:44:31.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.900+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:44:31.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.924+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:31.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:31.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:44:31.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.940+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:31.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.944+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:44:31.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.944+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:44:31.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.976+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:44:31.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:31.988+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:44:32.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.000+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:44:32.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:32.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.008+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:44:32.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.016+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:44:32.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.028+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:44:32.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.044+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:44:32.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:44:32.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.072+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:44:32.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.092+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:44:32.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:44:32.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.120+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:32.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.144+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:32.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.148+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:44:32.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.160+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:44:32.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 166 16 2134561 2134545 803.594 816.188 0.00131934 0.00123256 2024-09-16T03:44:32.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.164+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:44:32.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.176+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:44:32.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.180+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:32.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:44:32.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.200+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:44:32.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.204+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:32.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:44:32.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.236+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:44:32.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:32.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:44:32.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.280+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:32.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.284+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:44:32.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:44:32.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.312+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:44:32.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.316+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:44:32.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.324+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:44:32.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:44:32.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.340+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:44:32.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.348+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:44:32.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.376+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:44:32.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.380+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:44:32.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.384+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:44:32.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.404+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:44:32.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.412+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:44:32.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.412+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:44:32.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.436+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:44:32.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.444+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:44:32.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.448+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:44:32.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.464+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:32.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.488+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:44:32.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.492+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:32.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.512+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:32.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.512+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:44:32.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.512+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:32.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:44:32.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.548+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:32.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.572+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:32.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.576+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:32.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.584+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:44:32.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.600+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:44:32.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.604+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:32.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:44:32.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.648+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:44:32.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.660+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:44:32.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.668+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:44:32.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.680+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:32.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.684+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:32.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.684+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:44:32.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.688+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:44:32.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.700+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:32.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.712+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:44:32.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.728+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:44:32.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.736+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:44:32.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.740+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:44:32.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:32.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:32.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.768+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:44:32.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.776+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:32.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.796+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:32.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.796+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:44:32.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:32.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:44:32.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.844+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:44:32.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.848+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:44:32.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.864+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:44:32.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.884+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:32.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.888+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:44:32.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.904+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:44:32.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.920+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:32.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:44:32.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.936+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:44:32.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.948+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:32.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.980+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:44:32.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:44:33.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:32.996+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:44:33.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:44:33.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.020+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:44:33.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:33.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.028+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:33.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:33.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.064+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:44:33.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:44:33.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:33.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.084+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:44:33.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.096+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:44:33.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.116+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:33.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.132+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:44:33.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:33.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.152+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:44:33.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 167 16 2147586 2147570 803.655 814.062 0.0011827 0.00123246 2024-09-16T03:44:33.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.176+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:33.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.176+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:44:33.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.184+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:33.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.184+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:44:33.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.192+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:33.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.224+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:44:33.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.224+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:33.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.232+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:44:33.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:44:33.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.248+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:44:33.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.260+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:44:33.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:44:33.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.284+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:44:33.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:33.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.300+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:44:33.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.300+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:44:33.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.316+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:44:33.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.352+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:44:33.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.356+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:44:33.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.364+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:44:33.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.376+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:33.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.396+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:33.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.416+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:44:33.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:44:33.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.432+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:33.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.440+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:33.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.456+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:33.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.456+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:33.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.476+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:33.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.476+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:44:33.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.488+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:44:33.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.500+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:44:33.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.516+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:44:33.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:44:33.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:44:33.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.556+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:44:33.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.568+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:44:33.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.576+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:33.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.580+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:44:33.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.604+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:44:33.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:44:33.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:44:33.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.624+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:33.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.644+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:44:33.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.660+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:44:33.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.664+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:44:33.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.672+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:44:33.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.680+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:33.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.724+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:44:33.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.732+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:44:33.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:33.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.740+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:33.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:33.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.768+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:44:33.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.772+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:44:33.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.776+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:33.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.792+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:33.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.804+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:44:33.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.808+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:44:33.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.812+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:33.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.824+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:33.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.840+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:44:33.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.856+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:44:33.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.884+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:44:33.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:44:33.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.896+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:44:33.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.908+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:33.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.912+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:44:33.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.920+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:44:33.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.940+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:44:33.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.944+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:33.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:44:33.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.968+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:33.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.968+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:44:33.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:33.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:44:34.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.012+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:44:34.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.012+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:44:34.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:34.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.036+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:44:34.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.044+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:44:34.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.056+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:44:34.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.060+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:44:34.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.064+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:34.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.072+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:44:34.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.096+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:44:34.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.112+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:34.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.132+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:34.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:44:34.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.136+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:34.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.156+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:44:34.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:34.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 168 16 2160260 2160244 803.586 792.125 0.0010464 0.00123256 2024-09-16T03:44:34.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.172+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:44:34.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.188+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:44:34.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:34.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.200+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:44:34.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.204+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:44:34.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:44:34.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.236+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:34.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:44:34.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.248+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:34.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:44:34.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.268+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:34.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.272+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:34.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.272+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:44:34.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:44:34.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.296+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:44:34.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.324+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:44:34.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:44:34.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.336+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:44:34.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:44:34.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.348+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:34.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.360+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:34.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.364+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:44:34.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.368+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:44:34.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.396+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:44:34.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:44:34.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.404+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:34.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.416+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:44:34.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:44:34.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.436+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:44:34.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.460+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:44:34.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:34.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.468+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:44:34.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.484+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:34.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.492+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:34.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.500+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:34.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.516+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:34.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.516+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:44:34.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.524+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:34.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.536+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:34.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:44:34.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:34.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.580+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:34.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.588+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:44:34.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.596+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:44:34.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.620+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:44:34.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:44:34.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.632+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:34.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.656+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:34.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:44:34.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.684+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:34.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.696+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:44:34.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.720+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:44:34.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.720+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:34.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.732+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:34.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.736+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:44:34.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.748+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:44:34.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.756+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:44:34.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.772+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:44:34.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:44:34.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:44:34.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.792+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:44:34.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.804+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:34.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.828+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:44:34.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:44:34.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.844+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:44:34.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.844+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:44:34.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.864+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:44:34.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.868+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:44:34.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:44:34.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.892+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:44:34.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.912+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:34.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.924+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:44:34.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:44:34.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.956+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:44:34.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.964+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:34.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.976+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:44:35.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:34.996+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:35.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.008+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:44:35.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:44:35.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.016+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:35.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.024+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:44:35.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.032+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:35.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:44:35.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:35.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.076+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:35.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.100+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:44:35.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:35.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:44:35.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:44:35.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.152+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:35.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.156+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:44:35.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.156+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:35.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 169 16 2173041 2173025 803.558 798.812 0.000560582 0.00123259 2024-09-16T03:44:35.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.172+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:44:35.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.196+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:44:35.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.204+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:44:35.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.216+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:44:35.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.236+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:44:35.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.240+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:44:35.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.248+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:44:35.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.264+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:44:35.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.264+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:35.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.276+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:44:35.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.280+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:44:35.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:44:35.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.296+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:44:35.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.296+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:44:35.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:35.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.356+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:44:35.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.360+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:44:35.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.364+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:44:35.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.364+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:44:35.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.396+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:35.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.404+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:44:35.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.412+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:35.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:44:35.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.432+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:44:35.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.440+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:44:35.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.448+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:44:35.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.476+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:44:35.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.480+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:44:35.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.488+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:35.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:44:35.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:44:35.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.496+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:35.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.524+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:44:35.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.548+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:44:35.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.556+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:35.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.588+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:44:35.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.596+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:44:35.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:35.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.624+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:35.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.624+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:44:35.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:44:35.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.632+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:44:35.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:44:35.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:35.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:44:35.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.704+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:44:35.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.716+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:44:35.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.728+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:35.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:35.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.740+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:35.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:44:35.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.740+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:35.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.756+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:44:35.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.760+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:35.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.780+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:44:35.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.788+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:44:35.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.808+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:44:35.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.812+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:44:35.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.812+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:44:35.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.828+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:44:35.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.860+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:35.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.868+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:44:35.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.892+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:35.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:35.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:44:35.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.936+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:35.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.944+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:44:35.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.952+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:44:35.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.956+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:44:35.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:35.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:36.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:44:36.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.008+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:36.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:44:36.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.036+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:44:36.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.056+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:36.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.056+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:44:36.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.060+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:36.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.092+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:44:36.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.100+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:44:36.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.108+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:44:36.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.108+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:36.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:44:36.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.124+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:44:36.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.132+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:44:36.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:44:36.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.168+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:36.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 170 16 2185938 2185922 803.572 806.062 0.00152962 0.00123258 2024-09-16T03:44:36.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.176+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:44:36.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.192+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:36.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.208+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:44:36.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.208+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:44:36.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.212+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:36.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.228+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:44:36.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.244+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:44:36.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.252+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:36.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.260+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:36.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.276+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:36.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.312+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:44:36.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.320+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:36.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:36.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:36.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.340+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:44:36.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.376+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:36.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.380+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:36.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.392+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:44:36.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.404+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:44:36.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.412+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:44:36.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.412+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:36.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:44:36.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.432+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:36.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.436+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:44:36.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.436+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:36.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.452+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:44:36.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.460+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:44:36.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.468+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:44:36.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.488+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:36.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.500+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:36.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.516+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:36.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.536+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:44:36.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.552+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:44:36.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.556+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:36.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.560+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:44:36.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:36.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.612+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:36.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.616+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:36.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.620+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:36.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.628+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:44:36.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.628+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:44:36.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.660+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:44:36.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.664+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:36.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:44:36.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.696+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:44:36.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.704+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:44:36.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.712+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:36.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.716+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:44:36.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.740+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:44:36.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.764+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:44:36.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.768+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:36.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.772+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:44:36.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.776+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:44:36.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.796+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:44:36.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.816+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:44:36.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.828+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:44:36.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.828+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:44:36.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.828+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:44:36.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:36.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.840+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:44:36.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:36.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.876+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:44:36.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.876+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:44:36.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.880+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:36.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.888+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:44:36.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.892+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:44:36.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.916+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:36.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.920+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:44:36.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.940+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:44:36.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.964+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:37.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.972+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:44:37.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:44:37.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:36.984+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:44:37.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:44:37.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:44:37.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.008+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:44:37.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.012+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:44:37.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.028+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:44:37.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.040+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:44:37.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.044+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:37.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.056+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:37.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.064+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:37.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.080+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:37.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.096+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:37.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.120+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:44:37.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:44:37.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.132+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:44:37.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.148+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:37.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:44:37.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 171 16 2199059 2199043 803.668 820.062 0.00049754 0.00123244 2024-09-16T03:44:37.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.172+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:37.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:37.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:37.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.196+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:37.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.208+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:37.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.220+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:44:37.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.224+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:44:37.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.224+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:44:37.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.232+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:44:37.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.236+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:44:37.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.264+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:44:37.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:44:37.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.284+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:37.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.288+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:37.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.308+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:37.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.312+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:37.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.328+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:44:37.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.328+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:37.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.328+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:37.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.352+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:37.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.368+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:37.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.376+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:44:37.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.388+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:44:37.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.388+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:37.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.400+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:37.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.412+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:37.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:37.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.436+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:37.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.440+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:44:37.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.448+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:37.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:44:37.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.468+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:44:37.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.472+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:44:37.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.484+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:37.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.508+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:44:37.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.520+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:37.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.524+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:37.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.536+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:37.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.544+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:44:37.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.560+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:44:37.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.564+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:44:37.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.572+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:44:37.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:37.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.600+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:37.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.600+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:37.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.616+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:44:37.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.624+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:44:37.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.624+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:44:37.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.640+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:37.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.652+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:44:37.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.656+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:37.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.668+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:44:37.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.676+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:44:37.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.676+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:44:37.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:44:37.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.688+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:37.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.708+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:37.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:44:37.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.732+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:44:37.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:44:37.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.772+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:44:37.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.788+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:44:37.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:44:37.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:37.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.804+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:44:37.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.832+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:44:37.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.844+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:37.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.860+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:44:37.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.864+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:44:37.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.880+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:44:37.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.884+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:37.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:37.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.912+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:37.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.916+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:44:37.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.932+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:37.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.944+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:37.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.960+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:44:37.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:44:37.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.972+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:44:37.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:37.996+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:44:38.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.004+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:44:38.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:38.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.024+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:44:38.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.024+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:38.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:44:38.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.068+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:44:38.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.080+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:44:38.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.092+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:44:38.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.100+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:38.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:44:38.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.116+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:38.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.120+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:38.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.136+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:38.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.156+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:44:38.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.156+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:38.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 172 16 2211792 2211776 803.622 795.812 0.00105245 0.00123252 2024-09-16T03:44:38.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.196+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:44:38.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.200+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:44:38.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.216+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:44:38.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:38.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.232+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:38.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.264+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:38.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.272+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:44:38.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.304+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:44:38.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:44:38.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:44:38.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:44:38.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.332+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:38.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:38.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.344+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:44:38.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.368+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:44:38.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.380+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:44:38.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.400+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:38.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.416+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:44:38.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.432+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:44:38.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:44:38.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.468+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:44:38.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.476+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:44:38.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.500+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:44:38.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.512+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:38.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.512+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:38.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.540+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:44:38.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:44:38.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.568+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:38.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.584+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:44:38.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:44:38.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:38.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:38.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:44:38.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.624+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:38.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.648+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:38.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.648+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:38.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.660+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:44:38.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.668+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:44:38.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.684+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:44:38.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.704+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:38.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:44:38.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.744+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:38.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.764+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:38.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:44:38.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.804+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:44:38.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.812+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:38.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.824+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:38.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.824+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:44:38.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.840+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:44:38.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.844+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:44:38.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.872+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:44:38.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:44:38.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.876+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:44:38.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.892+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:44:38.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.948+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:38.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.952+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:44:38.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.952+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:44:38.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:38.996+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:39.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.000+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:39.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:44:39.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.028+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:39.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.044+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:39.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.044+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:39.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.064+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:44:39.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.068+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:44:39.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:44:39.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.076+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:44:39.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.080+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:44:39.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.124+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:39.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.124+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:44:39.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:44:39.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.144+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:44:39.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.160+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:44:39.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.160+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:44:39.170 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 173 16 2225277 2225261 803.848 842.812 0.000552292 0.00123216 2024-09-16T03:44:39.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:39.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.176+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:39.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.188+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:44:39.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.188+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:44:39.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.208+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:39.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.228+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:39.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.232+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:39.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.236+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:44:39.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:44:39.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.296+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:44:39.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.300+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:39.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.304+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:39.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.316+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:44:39.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:44:39.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:44:39.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.352+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:44:39.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.368+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:44:39.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.380+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:44:39.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.388+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:39.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.408+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:44:39.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.412+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:44:39.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:39.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:44:39.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:44:39.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.436+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:39.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.444+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:44:39.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:44:39.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:44:39.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.496+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:44:39.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.500+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:44:39.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:44:39.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.548+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:44:39.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.560+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:39.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:39.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.568+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:44:39.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.572+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:44:39.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.576+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:44:39.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.584+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:44:39.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.608+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:44:39.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.616+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:44:39.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.632+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:44:39.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.676+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:44:39.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:44:39.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.704+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:39.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.704+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:39.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:44:39.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:39.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:39.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.744+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:44:39.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.752+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:44:39.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.760+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:44:39.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:39.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.780+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:44:39.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.800+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:39.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.812+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:44:39.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.816+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:44:39.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.824+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:44:39.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.836+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:44:39.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.856+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:44:39.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.876+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:39.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.876+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:44:39.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.880+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:44:39.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:44:39.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.912+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:44:39.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.924+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:39.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.928+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:44:39.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:44:39.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.952+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:44:39.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.976+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:44:39.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:39.984+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:44:40.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:40.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:44:40.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.028+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:40.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.036+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:40.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.052+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:44:40.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:44:40.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.080+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:44:40.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.092+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:40.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.096+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:40.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.104+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:44:40.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.116+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:44:40.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.116+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:44:40.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 174 16 2237444 2237428 803.598 760.438 0.00054601 0.00123234 2024-09-16T03:44:40.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.196+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:44:40.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.204+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:40.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.228+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:40.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:44:40.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.260+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:44:40.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.264+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:44:40.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.272+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:44:40.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:44:40.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.288+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:40.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.300+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:44:40.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.304+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:44:40.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:44:40.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.332+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:44:40.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.352+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:44:40.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.360+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:44:40.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.372+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:44:40.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.380+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:44:40.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.388+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:44:40.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.388+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:40.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.416+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:44:40.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.428+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:44:40.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.444+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:44:40.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.444+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:40.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.456+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:44:40.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:40.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.464+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:44:40.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.484+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:44:40.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:44:40.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.488+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:44:40.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.492+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:44:40.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.504+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:44:40.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.508+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:44:40.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:44:40.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.544+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:44:40.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:40.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.572+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:40.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.584+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:40.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.584+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:40.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.592+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:44:40.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.600+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:44:40.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.624+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:40.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.644+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:40.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:44:40.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.672+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:40.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.684+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:44:40.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.700+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:44:40.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.724+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:40.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.728+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:44:40.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.752+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:44:40.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.752+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:44:40.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.764+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:44:40.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.764+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:40.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.808+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:44:40.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.816+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:40.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.824+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:44:40.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.836+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:44:40.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.848+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:44:40.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.856+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:40.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.864+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:40.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.884+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:44:40.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.884+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:40.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.908+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:44:40.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.924+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:44:40.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.932+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:40.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.940+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:44:40.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:40.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:40.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.948+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:44:40.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.968+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:44:40.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.968+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:44:40.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.988+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:44:41.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:40.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:44:41.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.016+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:41.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.032+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:44:41.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.044+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:44:41.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.048+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:41.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.056+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:41.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.056+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:44:41.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.068+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:41.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.084+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:41.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.096+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:44:41.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.100+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:41.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.136+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:44:41.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.144+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:44:41.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.152+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:44:41.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 175 16 2249932 2249916 803.465 780.5 0.00432453 0.00123275 2024-09-16T03:44:41.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.172+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:44:41.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.192+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:44:41.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.196+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:41.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.204+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:44:41.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.216+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:41.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.220+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:41.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.248+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:44:41.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:41.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.252+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:41.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.260+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:41.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.280+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:44:41.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.300+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:44:41.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.304+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:44:41.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.316+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:44:41.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.328+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:44:41.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.332+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:41.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.336+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:44:41.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:44:41.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:44:41.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.376+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:41.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:44:41.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.404+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:44:41.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.412+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:44:41.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.412+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:41.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.412+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:41.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:41.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:41.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.452+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:41.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.468+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:41.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.472+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:44:41.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:44:41.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.476+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:44:41.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:44:41.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.512+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:44:41.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.524+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:41.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.528+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:44:41.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.540+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:44:41.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.548+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:44:41.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.556+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:44:41.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.572+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:44:41.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.576+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:41.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.580+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:41.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.596+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:44:41.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.608+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:44:41.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.612+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:44:41.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.660+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:44:41.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.664+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:41.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.672+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:44:41.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.672+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:44:41.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.688+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:41.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.736+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:44:41.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.736+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:44:41.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.740+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:41.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.748+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:44:41.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.764+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:44:41.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.772+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:44:41.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.772+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:44:41.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.780+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:44:41.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.816+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:44:41.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.832+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:44:41.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.836+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:44:41.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.888+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:41.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.900+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:44:41.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.900+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:44:41.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.904+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:41.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:41.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.928+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:41.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.932+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:41.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:41.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.980+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:44:41.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:44:41.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:44:41.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:41.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:44:42.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.000+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:44:42.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.024+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:42.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:44:42.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.036+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:44:42.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.040+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:44:42.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:44:42.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.068+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:44:42.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.068+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:42.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.100+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:42.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:42.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:44:42.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.136+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:42.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.148+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:42.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.160+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:44:42.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:44:42.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.168+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:44:42.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 176 16 2262939 2262923 803.519 812.938 0.00225846 0.00123267 2024-09-16T03:44:42.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.184+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:44:42.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.192+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:42.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:44:42.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.228+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:42.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.240+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:42.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.248+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:44:42.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.256+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:42.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.272+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:44:42.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.280+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:44:42.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.284+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:42.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:42.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.300+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:44:42.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.312+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:42.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.328+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:44:42.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.348+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:44:42.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.348+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:44:42.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:44:42.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.376+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:44:42.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.376+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:44:42.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.384+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:44:42.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.408+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:44:42.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.416+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:44:42.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.424+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:44:42.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.428+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:44:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.444+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.448+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:44:42.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.456+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:44:42.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.468+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:44:42.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.492+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:44:42.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.492+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:44:42.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.504+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:44:42.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.512+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:42.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.516+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:44:42.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.520+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:44:42.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.536+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:44:42.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.540+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:44:42.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:44:42.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.556+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:42.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.568+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:42.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.588+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:42.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:44:42.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.616+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:44:42.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.620+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:42.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.636+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:44:42.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.648+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:44:42.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.648+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:42.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.660+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:42.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:44:42.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:44:42.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.692+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:44:42.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:44:42.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.708+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:42.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.720+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:42.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.728+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:44:42.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.756+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:44:42.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.760+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:44:42.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.768+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:42.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.776+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:42.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.792+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:44:42.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.796+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:44:42.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.808+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:44:42.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.816+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:44:42.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.836+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:44:42.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.852+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:44:42.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.860+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:44:42.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.884+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:44:42.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.896+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:44:42.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.896+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:44:42.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.920+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:44:42.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.924+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:44:42.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.932+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:44:42.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:44:42.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.940+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:44:42.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:42.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:44:43.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.000+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:44:43.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.011+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:44:43.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.019+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:44:43.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.031+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:44:43.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.043+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:44:43.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.067+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:44:43.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.075+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:44:43.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.079+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:44:43.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.099+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:43.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.107+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:44:43.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.107+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:43.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.115+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:44:43.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.135+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:44:43.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.135+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:43.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 177 16 2275718 2275702 803.491 798.688 0.00118781 0.0012327 2024-09-16T03:44:43.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:44:43.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.175+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:43.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.203+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:43.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:44:43.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:43.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.235+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:44:43.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.247+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:43.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.259+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:43.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.263+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:44:43.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:44:43.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.279+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:44:43.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:44:43.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.291+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:44:43.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.339+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:44:43.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.343+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:44:43.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.347+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:43.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:44:43.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.375+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:43.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.395+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:43.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:44:43.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.399+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:44:43.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.427+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:44:43.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.459+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:44:43.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.479+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:44:43.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.479+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:44:43.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.483+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:43.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.507+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:43.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.531+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:44:43.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.535+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:44:43.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.543+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:44:43.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.563+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:43.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:43.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.567+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:44:43.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:44:43.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.611+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:44:43.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:44:43.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:43.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.643+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:44:43.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.651+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:43.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.663+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:44:43.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.679+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:44:43.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.679+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:44:43.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.707+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:44:43.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.727+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:44:43.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.739+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:44:43.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.747+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:44:43.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.763+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:44:43.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.771+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:43.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.779+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:44:43.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.791+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:43.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.811+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:44:43.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.835+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:44:43.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.839+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:44:43.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:43.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.855+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:43.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.875+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:44:43.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.895+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:43.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.895+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:44:43.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.923+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:44:43.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:44:43.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.951+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:43.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.963+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:44:43.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.983+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:44:44.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:43.999+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:44:44.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.015+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:44:44.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.015+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:44:44.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.031+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:44:44.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.039+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:44.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.071+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:44:44.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.083+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:44:44.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.087+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:44:44.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.091+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:44:44.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.091+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:44.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.095+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:44:44.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.123+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:44:44.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.127+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:44.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.147+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:44:44.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.151+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:44.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.159+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:44:44.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 178 15 2288849 2288834 803.588 820.75 0.000766939 0.00123257 2024-09-16T03:44:44.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.167+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:44:44.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.175+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:44:44.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:44:44.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:44:44.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.227+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:44.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:44.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.251+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:44:44.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.255+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:44:44.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.271+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:44.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.271+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:44:44.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.287+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:44:44.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.291+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:44:44.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.303+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:44:44.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.319+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:44.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.323+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:44:44.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.327+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:44:44.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.343+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:44:44.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.363+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:44:44.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.367+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:44:44.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:44:44.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:44:44.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.403+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:44:44.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.419+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:44:44.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.451+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:44:44.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.455+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:44.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:44:44.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.467+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:44.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.483+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:44.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.503+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:44.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.511+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:44:44.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.519+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:44:44.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.531+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:44.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.539+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:44:44.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.567+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:44:44.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.575+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:44:44.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.587+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:44.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.599+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:44:44.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.611+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:44:44.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.639+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:44:44.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.655+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:44:44.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:44:44.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.671+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:44:44.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.679+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:44:44.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.687+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:44.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.691+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:44.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.715+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:44:44.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.767+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:44:44.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.767+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:44:44.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.775+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:44.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.779+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:44:44.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.787+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:44:44.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.811+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:44:44.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.819+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:44:44.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.819+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:44:44.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.863+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:44:44.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.867+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:44.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.883+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:44.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.883+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:44:44.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.891+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:44:44.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.911+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:44.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.915+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:44:44.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.943+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:44:44.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.947+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:44:44.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.947+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:44:44.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.963+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:44:44.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.967+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:44:44.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:44.983+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:44:45.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.003+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:44:45.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:45.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.015+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:45.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.039+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:44:45.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.059+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:44:45.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.059+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:44:45.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.063+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:44:45.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.071+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:44:45.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.083+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:45.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.095+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:45.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.107+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:44:45.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.107+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:45.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.111+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:44:45.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.147+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:45.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.151+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:44:45.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.155+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:44:45.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.159+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:44:45.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 179 16 2301877 2301861 803.647 814.188 0.00116209 0.00123246 2024-09-16T03:44:45.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:45.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.195+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:44:45.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.215+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:44:45.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.227+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:44:45.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.227+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:44:45.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.239+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:44:45.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.251+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:44:45.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.263+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:44:45.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:45.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.267+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:44:45.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.307+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:44:45.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.315+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:44:45.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.315+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:44:45.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.339+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:44:45.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.343+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:45.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.347+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:44:45.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.363+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:44:45.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.379+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:44:45.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:44:45.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:45.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:45.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.431+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:44:45.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.435+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:44:45.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.443+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:45.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.455+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:45.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.459+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:45.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.463+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:44:45.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.479+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:45.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.491+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:44:45.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.507+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:44:45.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.515+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:44:45.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.527+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:44:45.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.531+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:44:45.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.539+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:44:45.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.555+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:44:45.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.567+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:44:45.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.579+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:44:45.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.583+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:44:45.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.595+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:44:45.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.615+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:44:45.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.619+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:44:45.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:44:45.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.627+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:44:45.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.651+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:45.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.651+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:44:45.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.687+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:44:45.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.691+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:44:45.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.703+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:44:45.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.707+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:44:45.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.711+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:44:45.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:44:45.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.755+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:44:45.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.755+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:44:45.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.771+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:44:45.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.799+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:45.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.799+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:44:45.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.811+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:44:45.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.823+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:44:45.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.847+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:44:45.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.851+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:45.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.859+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:44:45.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.879+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:45.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.895+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:44:45.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.895+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:45.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:44:45.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.923+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:44:45.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.939+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:44:45.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.975+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:44:45.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.983+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:45.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.991+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:44:46.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:45.999+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:44:46.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.035+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:44:46.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.043+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:46.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.047+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:44:46.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:44:46.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.067+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:44:46.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.067+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:46.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:46.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.087+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:44:46.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.099+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:46.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.107+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:44:46.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.111+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:46.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.147+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:44:46.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.167+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:44:46.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:44:46.171482+0000 min lat: 0.000234761 max lat: 0.129137 avg lat: 0.00123229 2024-09-16T03:44:46.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:44:46.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 180 16 2315079 2315063 803.765 825.125 0.000655344 0.00123229 2024-09-16T03:44:46.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.179+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:44:46.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:46.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.183+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:46.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:46.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.203+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:44:46.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.211+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:44:46.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.227+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:46.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.239+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:46.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:46.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.275+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:44:46.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:44:46.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:44:46.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.303+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:44:46.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.323+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:46.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.335+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:44:46.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.351+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:44:46.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:46.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.363+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:46.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.379+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:44:46.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.387+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:46.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.387+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:44:46.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.399+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:44:46.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.407+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:44:46.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.431+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:44:46.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.435+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:46.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:46.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.455+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:44:46.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.467+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:46.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:44:46.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.503+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:44:46.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.503+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:44:46.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.507+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:46.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.523+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:46.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:44:46.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.531+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:46.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.535+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:44:46.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.547+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:44:46.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.551+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:46.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.563+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:44:46.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.599+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:44:46.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.607+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:44:46.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.623+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:44:46.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.627+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:44:46.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.655+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:46.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.663+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:46.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.671+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:44:46.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.671+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:44:46.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.671+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:46.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.715+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:44:46.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.735+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:44:46.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.747+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:44:46.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.747+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:44:46.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.751+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:44:46.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.771+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:44:46.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:44:46.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.799+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:44:46.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.807+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:44:46.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.815+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:44:46.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.831+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:44:46.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:44:46.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:46.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.867+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:46.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.875+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:44:46.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.879+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:46.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.895+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:44:46.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.915+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:46.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.935+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:46.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.935+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:44:46.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.939+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:46.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.955+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:44:46.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:44:47.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:46.999+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:47.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.007+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:44:47.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:47.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:44:47.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.051+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:44:47.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.051+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:44:47.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:44:47.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.071+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:44:47.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:47.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.099+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:44:47.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:44:47.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.103+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:44:47.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.107+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:47.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.111+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:44:47.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.151+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:44:47.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:44:47.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.155+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:47.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:44:47.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.159+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:44:47.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.163+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:44:47.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 181 16 2328415 2328399 803.929 833.5 0.000580191 0.00123202 2024-09-16T03:44:47.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.199+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:44:47.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.211+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:44:47.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.219+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:44:47.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.219+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:47.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.231+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:44:47.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.235+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:47.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.239+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:47.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.259+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:44:47.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.263+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:44:47.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.287+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:47.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.287+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:44:47.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.307+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:44:47.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.319+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:44:47.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.323+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:44:47.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.347+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:44:47.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.371+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:44:47.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.383+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:44:47.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.387+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:44:47.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.403+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:44:47.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.415+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:47.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:44:47.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.423+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:44:47.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.431+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:44:47.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:47.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:44:47.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.475+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:44:47.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:44:47.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:44:47.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.519+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:47.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.539+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:44:47.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.551+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:47.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.559+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:44:47.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.563+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:44:47.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.583+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:44:47.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.583+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:47.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.587+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:47.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.599+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:44:47.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.603+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:47.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.639+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:44:47.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.639+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:44:47.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.643+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:44:47.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.663+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:44:47.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.671+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:47.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.695+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:44:47.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.699+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:47.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.711+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:44:47.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.731+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:44:47.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.759+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:47.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.763+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:44:47.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.763+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:44:47.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.783+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:47.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.783+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:44:47.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:44:47.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.819+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:47.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.823+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:44:47.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.827+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:44:47.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.839+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:44:47.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.843+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:44:47.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.843+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:44:47.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.843+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:44:47.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.871+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:44:47.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.875+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:44:47.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.903+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:47.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.903+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:47.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.955+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:44:47.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.959+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:44:47.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.971+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:44:47.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.983+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:44:47.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.987+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:44:47.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.987+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:47.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:47.995+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:44:48.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.003+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:44:48.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.027+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:44:48.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.031+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:44:48.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.039+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:44:48.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.039+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:44:48.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.047+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:44:48.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.075+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:44:48.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.087+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:44:48.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.095+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:44:48.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.099+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:44:48.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.107+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:48.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:44:48.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.123+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:48.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.143+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:48.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:44:48.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 182 16 2341539 2341523 804.018 820.25 0.000884993 0.0012319 2024-09-16T03:44:48.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.171+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:44:48.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.175+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:44:48.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:44:48.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.183+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:44:48.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.207+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:44:48.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.219+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:44:48.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.231+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:44:48.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.243+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:44:48.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.243+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:44:48.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.267+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:44:48.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.271+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:48.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.283+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:44:48.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.307+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:44:48.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.319+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:44:48.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:44:48.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.323+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:48.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.347+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:48.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.383+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:44:48.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.403+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:48.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.407+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:44:48.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.423+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:48.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.443+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:48.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.451+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:48.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.479+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:44:48.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.483+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:44:48.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:44:48.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.499+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:44:48.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.523+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:44:48.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.527+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:44:48.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.535+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:44:48.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.539+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:48.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.547+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:44:48.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.567+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:44:48.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:48.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.571+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:44:48.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:44:48.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.619+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:44:48.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.635+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:48.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:44:48.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.635+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:44:48.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.667+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:44:48.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.671+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:48.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:44:48.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.683+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:44:48.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.691+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:48.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.715+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:44:48.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.723+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:48.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.723+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:48.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.743+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:44:48.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.743+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:48.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.767+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:44:48.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.795+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:44:48.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.807+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:44:48.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.807+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:44:48.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.819+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:44:48.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.823+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:44:48.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.843+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:44:48.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.843+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:48.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:44:48.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.863+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:44:48.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.891+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:44:48.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.895+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:48.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:48.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.927+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:44:48.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:44:48.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.931+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:44:48.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.963+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:44:48.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.967+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:44:48.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.983+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:48.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:48.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:44:49.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.003+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:44:49.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.011+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:44:49.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.011+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:44:49.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:44:49.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.035+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:44:49.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.039+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:49.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:44:49.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.087+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:49.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.107+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:44:49.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:44:49.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:49.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.143+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:44:49.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:44:49.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.155+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:44:49.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 183 16 2354473 2354457 804.042 808.375 0.000964244 0.00123185 2024-09-16T03:44:49.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.175+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:44:49.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.183+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:44:49.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.195+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:44:49.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.215+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:44:49.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.227+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:44:49.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:49.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.255+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:49.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.263+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:44:49.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.287+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:44:49.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.287+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:44:49.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.291+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:44:49.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.295+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:44:49.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.303+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:44:49.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.307+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:44:49.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.331+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:49.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.343+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:44:49.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:44:49.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.383+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:44:49.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.391+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:49.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.439+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:49.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.443+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:44:49.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.487+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:44:49.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.495+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:49.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.503+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:44:49.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.511+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:49.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:49.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.535+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:44:49.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.555+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:49.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.563+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:44:49.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.563+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:49.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.579+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:49.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.587+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:44:49.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.595+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:49.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.623+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:44:49.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:44:49.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.639+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:44:49.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.643+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:49.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.659+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:44:49.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:49.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.819+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:49.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.847+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:44:49.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.851+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:44:49.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.863+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:49.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.871+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:49.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.883+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:49.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.887+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:49.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.903+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:49.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.923+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:49.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.931+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:44:49.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.971+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:44:49.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.971+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:44:49.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:49.983+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:44:50.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.007+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:44:50.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.015+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:44:50.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.023+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:44:50.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.023+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:44:50.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.035+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:44:50.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.039+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:44:50.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.047+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:44:50.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.063+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:50.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.067+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:44:50.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.067+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:44:50.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.075+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:44:50.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.107+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:50.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.107+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:50.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.123+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:44:50.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.135+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:44:50.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.139+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:44:50.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.155+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:44:50.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.167+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:44:50.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.167+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:44:50.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 184 15 2366157 2366142 803.641 730.312 0.000858629 0.00123248 2024-09-16T03:44:50.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.171+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:44:50.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:44:50.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.219+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:44:50.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.239+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:44:50.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.251+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:44:50.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.263+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:44:50.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:44:50.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.271+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:44:50.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.275+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:50.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:44:50.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.299+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:44:50.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.315+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:44:50.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.319+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:44:50.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.323+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:44:50.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.323+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:50.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.347+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:44:50.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.355+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:50.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.359+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:44:50.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.375+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:50.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.383+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:50.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.411+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:50.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:44:50.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.427+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:44:50.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.439+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:50.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.451+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:44:50.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.455+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:44:50.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.463+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:50.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.479+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:44:50.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.491+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:44:50.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.499+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:50.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.503+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:44:50.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:44:50.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.575+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:44:50.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.583+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:44:50.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:44:50.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.599+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:50.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.607+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:44:50.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.623+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:44:50.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.627+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:44:50.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.631+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:44:50.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.659+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:44:50.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.663+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:44:50.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:50.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.683+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:44:50.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.707+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:44:50.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.715+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:44:50.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.719+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:44:50.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.719+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:44:50.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.727+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:44:50.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:44:50.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.735+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:44:50.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:44:50.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.815+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:50.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.823+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:44:50.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:44:50.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.839+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:44:50.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.839+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:44:50.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.859+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:44:50.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.871+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:44:50.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.883+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:44:50.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.887+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:44:50.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.891+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:44:50.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.903+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:44:50.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.907+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:50.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.911+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:44:50.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.919+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:44:50.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.923+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:50.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.935+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:44:50.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.951+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:50.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.979+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:44:50.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:50.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:50.995+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:44:51.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.003+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:44:51.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.015+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:44:51.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.015+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:44:51.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.027+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:44:51.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.039+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:44:51.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.059+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:44:51.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.067+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:44:51.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:44:51.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.103+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:44:51.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.111+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:44:51.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.131+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:44:51.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.147+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:51.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.155+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:44:51.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:44:51.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.163+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:44:51.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 185 16 2379116 2379100 803.674 809.875 0.000684496 0.00123242 2024-09-16T03:44:51.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.171+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:44:51.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.175+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:44:51.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.215+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:44:51.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:44:51.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.227+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:44:51.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.231+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:44:51.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:44:51.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.255+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:51.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:44:51.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.283+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:44:51.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.299+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:44:51.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.315+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:44:51.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.323+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:44:51.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.339+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:44:51.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.339+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:51.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.355+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:51.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.363+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:44:51.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:44:51.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.383+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:44:51.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.383+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:44:51.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:44:51.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:44:51.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.419+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:44:51.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.427+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:44:51.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:44:51.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.459+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:51.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:44:51.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.471+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:51.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:51.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.491+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:51.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.507+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:44:51.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.519+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:44:51.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.543+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:51.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.555+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:44:51.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.563+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:44:51.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.575+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:44:51.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.575+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:44:51.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.599+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:44:51.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.619+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:44:51.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.627+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:44:51.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:44:51.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.635+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:44:51.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.639+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:44:51.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.639+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:44:51.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:44:51.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.663+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:44:51.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:44:51.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.695+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:44:51.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.707+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:44:51.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.707+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:51.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.727+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:44:51.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:44:51.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.755+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:44:51.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.755+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:44:51.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.755+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:44:51.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.775+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:44:51.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.775+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:44:51.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.791+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:44:51.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.803+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:44:51.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.819+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:44:51.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.839+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:51.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.855+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:44:51.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.863+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:44:51.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.867+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:44:51.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.907+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:44:51.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.907+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:44:51.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:44:51.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.919+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:51.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.951+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:51.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.955+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:51.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.959+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:44:51.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.967+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:44:51.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:51.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:51.991+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:44:52.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.007+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:44:52.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.011+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:44:52.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.015+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:52.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.019+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:52.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:44:52.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.031+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:44:52.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.047+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:52.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.059+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:44:52.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.067+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:44:52.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.075+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:44:52.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.087+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:44:52.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.103+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:44:52.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.127+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:44:52.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.131+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:44:52.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:44:52.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.147+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:44:52.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.151+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:52.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.159+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:44:52.171 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 186 15 2392029 2392014 803.692 807.125 0.000726277 0.00123239 2024-09-16T03:44:52.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.171+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:44:52.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.191+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:44:52.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:44:52.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:44:52.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.255+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:44:52.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.291+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:44:52.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.295+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:52.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:44:52.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.319+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:44:52.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:44:52.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:44:52.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.355+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:44:52.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.379+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:44:52.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.379+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:44:52.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.391+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:52.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.403+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:44:52.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.403+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:52.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.415+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:44:52.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.423+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:44:52.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.451+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:52.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.455+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:52.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.459+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:44:52.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:44:52.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.467+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:44:52.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.471+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:44:52.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.479+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:44:52.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.487+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:52.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.495+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:44:52.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.511+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:44:52.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.519+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:44:52.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.543+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:44:52.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.559+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:44:52.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.579+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:52.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.599+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:44:52.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.603+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:44:52.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.607+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:44:52.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.607+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:44:52.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.623+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:44:52.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.627+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:52.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.639+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:44:52.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.671+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:44:52.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.671+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:44:52.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.679+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:52.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.687+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:44:52.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.711+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:44:52.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.719+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:44:52.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.727+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:44:52.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.731+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:44:52.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.735+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:52.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.751+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:44:52.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.755+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:44:52.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.783+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:44:52.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.799+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:44:52.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.811+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:52.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:44:52.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.823+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:44:52.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.835+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:44:52.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.839+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:44:52.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.847+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:44:52.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.879+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:44:52.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.899+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:44:52.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.911+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:44:52.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.911+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:44:52.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.927+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:52.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:52.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.955+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:52.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:44:52.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:52.991+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:44:53.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.003+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:44:53.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.015+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:44:53.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.035+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:44:53.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.047+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:44:53.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:44:53.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.067+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:44:53.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.075+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:44:53.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.075+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:44:53.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:44:53.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:44:53.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.099+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:44:53.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.107+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:53.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.135+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:44:53.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.139+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:44:53.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.159+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:44:53.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 187 15 2405276 2405261 803.821 827.938 0.000818918 0.00123221 2024-09-16T03:44:53.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:53.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.211+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:53.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.215+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:44:53.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.215+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:53.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.219+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:53.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.235+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:44:53.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.251+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:44:53.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:44:53.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.255+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:53.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.283+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:44:53.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.315+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:44:53.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.323+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:44:53.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.331+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:44:53.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.339+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:44:53.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:44:53.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.343+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:44:53.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.367+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:53.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.379+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:44:53.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.391+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:44:53.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.395+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:53.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.403+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:53.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.407+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:44:53.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.415+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:44:53.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.427+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:44:53.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.455+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:44:53.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.459+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:44:53.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:53.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.491+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:44:53.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.491+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:44:53.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:44:53.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.519+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:44:53.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.547+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:53.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.563+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:44:53.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:44:53.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.579+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:44:53.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:44:53.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.615+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:44:53.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.635+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:44:53.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.639+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:44:53.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.651+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:44:53.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.655+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:44:53.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:44:53.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.679+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:44:53.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.687+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:44:53.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.703+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:44:53.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.703+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:44:53.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.707+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:44:53.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.735+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:53.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.743+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:44:53.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.755+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:44:53.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.755+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:44:53.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.775+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:44:53.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.799+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:44:53.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.799+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:44:53.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.807+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:53.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.811+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:44:53.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.827+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:44:53.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.831+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:44:53.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.847+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:44:53.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.851+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:53.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.871+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:44:53.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.883+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:53.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.887+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:53.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:44:53.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.927+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:44:53.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.931+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:44:53.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.943+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:44:53.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:44:53.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:44:53.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.975+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:44:53.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:53.987+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:44:54.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.003+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:44:54.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.003+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:44:54.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.011+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:44:54.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.027+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:54.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.039+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:44:54.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.047+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:44:54.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:44:54.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.063+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:44:54.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.075+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:44:54.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:44:54.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:44:54.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.091+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:44:54.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.091+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:44:54.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.115+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:44:54.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:54.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.139+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:44:54.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.147+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:44:54.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.155+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:44:54.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:54.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 188 16 2418283 2418267 803.869 812.875 0.000915266 0.00123212 2024-09-16T03:44:54.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.175+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:44:54.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.187+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:44:54.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.191+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:44:54.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.195+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:44:54.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.195+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:44:54.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.207+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:44:54.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.219+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:44:54.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.235+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:54.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:44:54.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.251+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:44:54.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.255+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:44:54.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.267+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:44:54.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.279+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:54.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.291+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:54.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.315+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:44:54.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.315+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:44:54.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.355+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:44:54.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.371+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:54.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.387+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:44:54.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.391+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:44:54.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:54.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.403+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:44:54.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.419+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:44:54.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.435+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:44:54.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:44:54.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.471+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:44:54.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:44:54.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:44:54.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:54.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.535+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:44:54.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.543+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:54.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.547+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:44:54.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.547+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:54.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.575+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:44:54.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.579+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:54.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.599+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:54.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.615+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:44:54.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:44:54.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:44:54.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.647+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:44:54.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.667+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:44:54.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.671+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:44:54.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.679+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:44:54.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:44:54.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.703+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:44:54.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.703+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:54.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.719+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:44:54.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.723+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:44:54.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.743+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:44:54.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.751+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:54.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.755+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:44:54.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.779+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:54.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.787+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:44:54.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.791+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:44:54.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.811+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:44:54.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.827+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:44:54.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.843+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:44:54.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:44:54.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.847+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:44:54.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.851+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:44:54.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:44:54.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.871+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:44:54.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:44:54.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.887+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:44:54.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:44:54.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.915+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:44:54.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.939+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:44:54.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.943+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:44:54.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.975+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:44:54.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.975+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:54.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:54.987+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:44:55.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.003+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:44:55.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.007+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:55.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.019+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:44:55.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.031+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:44:55.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.031+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:44:55.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:44:55.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.051+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:55.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.071+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:44:55.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.083+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:44:55.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:44:55.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.103+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:44:55.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:44:55.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.119+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:44:55.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.151+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:44:55.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.159+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:55.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 189 16 2430750 2430734 803.738 779.188 0.00126233 0.00123232 2024-09-16T03:44:55.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:44:55.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.191+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:44:55.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.199+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:44:55.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.211+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:44:55.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.219+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:44:55.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.251+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:55.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.255+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:44:55.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.259+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:44:55.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.275+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:44:55.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:55.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.291+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:44:55.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.299+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:44:55.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.307+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:55.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.315+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:44:55.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.331+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:44:55.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.335+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:44:55.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.339+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:44:55.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.351+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:44:55.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.367+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:44:55.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:55.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.395+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:44:55.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.395+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:44:55.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.399+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:44:55.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:55.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.423+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:55.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.455+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:55.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:44:55.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.491+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:44:55.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.491+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:44:55.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.515+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:55.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.527+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:44:55.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.539+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:55.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.539+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:44:55.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.559+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:44:55.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.567+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:44:55.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.575+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:44:55.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.579+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:44:55.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.599+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:44:55.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.611+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:44:55.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:44:55.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:44:55.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:44:55.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.659+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:44:55.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.659+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:44:55.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.675+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:44:55.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.679+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:44:55.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.715+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:44:55.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.719+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:44:55.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.743+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:44:55.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.755+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:44:55.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.759+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:44:55.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.779+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:44:55.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.783+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:44:55.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.783+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:44:55.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.815+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:44:55.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.815+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:44:55.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.839+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:44:55.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:44:55.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.863+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:44:55.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.879+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:44:55.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.895+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:44:55.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:44:55.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.915+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:44:55.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.927+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:55.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.955+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:55.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.959+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:44:55.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.983+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:44:56.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:55.995+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:44:56.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.003+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:44:56.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.019+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:44:56.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.039+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:44:56.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.039+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:44:56.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.043+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:44:56.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.079+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:44:56.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.091+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:44:56.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.095+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:56.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.103+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:44:56.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.119+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:44:56.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.123+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:44:56.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.135+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:44:56.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.143+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:44:56.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.151+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:44:56.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 190 16 2444029 2444013 803.876 829.938 0.00133928 0.00123211 2024-09-16T03:44:56.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.171+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:44:56.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.179+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:44:56.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.187+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:44:56.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.187+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:44:56.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.207+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:44:56.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.223+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:44:56.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.235+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:44:56.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.283+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:44:56.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.287+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:44:56.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:44:56.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.303+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:44:56.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:56.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:44:56.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.319+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:44:56.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.347+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:44:56.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.355+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:44:56.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.367+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:56.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.371+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:44:56.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.371+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:44:56.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.395+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:44:56.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:56.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:44:56.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.443+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:44:56.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.443+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:44:56.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.475+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:44:56.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.479+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:44:56.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.487+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:44:56.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.487+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:44:56.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.487+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:44:56.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.515+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:44:56.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.519+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:44:56.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.523+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:44:56.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.527+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:44:56.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.531+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:44:56.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.563+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:44:56.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.579+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:56.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.587+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:44:56.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.595+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:44:56.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.599+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:44:56.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.619+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:44:56.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:44:56.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.623+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:44:56.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.679+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:44:56.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.683+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:44:56.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.683+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:44:56.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.711+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:44:56.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.711+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:44:56.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:44:56.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.751+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:56.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.783+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:44:56.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.787+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:44:56.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.791+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:44:56.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.807+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:44:56.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.807+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:44:56.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.807+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:44:56.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.843+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:44:56.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.851+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:44:56.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.855+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:44:56.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.867+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:44:56.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.891+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:44:56.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.899+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:44:56.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.903+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:56.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.911+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:44:56.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.919+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:44:56.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.927+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:44:56.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.939+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:44:56.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.951+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:56.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.971+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:44:56.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:44:56.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.979+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:44:56.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:56.991+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:44:57.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.003+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:44:57.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.023+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:44:57.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.047+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:44:57.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:44:57.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.059+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:44:57.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.071+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:44:57.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.071+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:44:57.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.075+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:44:57.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.079+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:44:57.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.091+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:44:57.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:57.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.107+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:44:57.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:44:57.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.131+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:44:57.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.139+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:44:57.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.147+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:44:57.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.151+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:44:57.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.163+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:44:57.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 191 16 2456665 2456649 803.801 789.75 0.000702494 0.00123221 2024-09-16T03:44:57.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.187+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:44:57.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:44:57.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:44:57.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.231+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:44:57.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.251+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:44:57.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.251+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:44:57.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.259+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:44:57.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.271+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:44:57.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.291+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:44:57.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.291+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:44:57.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.299+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:44:57.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.303+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:44:57.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.331+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:44:57.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.331+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:44:57.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.343+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:44:57.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.351+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:44:57.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:44:57.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:44:57.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:44:57.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.419+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:44:57.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:44:57.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.447+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:44:57.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.475+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:44:57.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.475+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:44:57.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.491+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:44:57.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.491+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:57.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.495+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:44:57.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.507+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:44:57.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:44:57.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:57.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.551+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:44:57.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.551+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:44:57.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.555+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:44:57.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:44:57.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.587+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:44:57.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:44:57.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:44:57.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.623+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:44:57.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.627+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:44:57.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.647+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:44:57.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.651+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:44:57.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.655+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:44:57.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.667+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:44:57.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.675+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:44:57.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.687+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:44:57.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.691+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:44:57.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.691+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:44:57.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.711+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:44:57.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:44:57.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.739+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:44:57.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:57.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.771+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:44:57.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.775+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:44:57.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.779+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:44:57.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.791+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:44:57.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.799+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:44:57.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.819+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:44:57.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.819+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:44:57.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.831+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:44:57.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:44:57.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.863+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:44:57.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.891+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:44:57.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.919+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:44:57.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.923+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:44:57.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.923+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:44:57.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:44:57.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.943+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:57.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.951+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:44:57.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.963+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:44:58.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:57.995+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:44:58.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.019+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:44:58.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.039+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:44:58.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:44:58.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.059+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:44:58.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.063+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:44:58.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.067+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:44:58.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.067+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:44:58.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.067+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:44:58.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:44:58.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.123+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:44:58.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:44:58.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.139+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:44:58.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.143+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:44:58.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.151+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:44:58.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.167+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:44:58.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 192 16 2469669 2469653 803.848 812.75 0.000539972 0.00123214 2024-09-16T03:44:58.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.179+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:44:58.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.199+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:44:58.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.203+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:44:58.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.211+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:44:58.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.231+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:44:58.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.231+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:58.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.247+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:44:58.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.259+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:44:58.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:44:58.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.287+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:44:58.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.303+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:44:58.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.315+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:44:58.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.323+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:44:58.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:44:58.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.347+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:44:58.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.363+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:44:58.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.375+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:44:58.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.407+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:44:58.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.411+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:58.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.419+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:44:58.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.423+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:44:58.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.471+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:44:58.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.475+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:44:58.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.475+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:44:58.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.499+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:44:58.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.503+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:44:58.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.511+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:44:58.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.519+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:44:58.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.535+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:44:58.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.559+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:44:58.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.567+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:44:58.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.587+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:44:58.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.587+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:44:58.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.587+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:44:58.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.595+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:44:58.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.627+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:44:58.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:44:58.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.651+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:44:58.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.655+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:44:58.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.671+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:44:58.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.691+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:44:58.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.707+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:44:58.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.735+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:44:58.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.739+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:44:58.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.783+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:44:58.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.787+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:44:58.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.819+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:44:58.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.819+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:44:58.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.843+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:44:58.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.851+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:44:58.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.855+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:44:58.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.875+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:44:58.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.883+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:44:58.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.883+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:44:58.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.895+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:44:58.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.911+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:44:58.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.919+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:44:58.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:44:58.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.935+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:44:58.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.939+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:44:58.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.947+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:44:58.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.959+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:44:58.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.967+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:44:58.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.987+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:44:59.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:58.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:44:59.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.007+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:44:59.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.019+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:44:59.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.019+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:44:59.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.027+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:44:59.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.035+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:44:59.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.047+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:44:59.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.047+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:44:59.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.063+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:44:59.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:44:59.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.095+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:44:59.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.107+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:44:59.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.127+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:44:59.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.155+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:44:59.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 193 16 2482681 2482665 803.896 813.25 0.000914262 0.0012321 2024-09-16T03:44:59.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.175+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:44:59.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.179+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:44:59.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.187+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:59.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.195+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:44:59.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.199+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:44:59.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.219+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:44:59.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.227+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:44:59.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.227+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:44:59.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.243+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:44:59.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.255+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:44:59.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.271+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:44:59.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.283+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:44:59.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:44:59.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.291+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:44:59.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.299+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:44:59.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.311+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:44:59.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.319+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:44:59.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.347+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:44:59.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.359+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:44:59.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.371+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:44:59.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.375+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:44:59.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.391+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:44:59.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.403+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:44:59.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.415+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:44:59.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.439+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:44:59.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.439+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:44:59.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.467+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:44:59.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.475+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:44:59.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.495+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:44:59.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.503+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:44:59.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.519+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:44:59.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.523+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:44:59.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.535+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:44:59.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.539+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:44:59.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.547+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:44:59.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.583+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:44:59.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.587+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:44:59.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.615+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:44:59.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.619+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:44:59.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.623+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:44:59.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:44:59.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.655+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:44:59.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.671+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:44:59.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.675+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:44:59.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.687+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:44:59.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.711+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:44:59.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.715+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:44:59.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.715+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:44:59.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.771+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:44:59.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.783+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:44:59.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.803+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:44:59.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.823+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:44:59.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.827+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:44:59.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:44:59.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.863+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:44:59.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.867+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:44:59.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.871+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:44:59.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.883+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:44:59.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.895+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:44:59.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.923+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:44:59.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.927+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:44:59.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.939+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:44:59.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.943+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:44:59.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:44:59.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.963+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:45:00.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:44:59.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:45:00.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.023+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:00.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.023+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:45:00.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.047+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:45:00.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.055+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:45:00.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.055+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:45:00.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.059+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:00.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.067+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:45:00.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.111+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:45:00.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.123+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:45:00.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.139+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:45:00.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.147+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:45:00.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.163+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:00.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 194 16 2495047 2495031 803.736 772.875 0.000727275 0.00123234 2024-09-16T03:45:00.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.179+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:45:00.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.179+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:45:00.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:00.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.203+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:00.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.207+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:00.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.223+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:45:00.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.239+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:00.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.255+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:45:00.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.255+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:45:00.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:00.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.287+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:45:00.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.307+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:45:00.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.315+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:00.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.315+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:00.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.339+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:45:00.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.339+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:45:00.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:45:00.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.351+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:45:00.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.379+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:00.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.391+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:00.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.391+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:45:00.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.391+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:45:00.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.399+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:00.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:45:00.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.431+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:45:00.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:45:00.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.455+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:45:00.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.455+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:45:00.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.455+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:45:00.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:45:00.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.499+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:00.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:45:00.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.515+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:00.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.515+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:45:00.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.543+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:00.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.555+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:45:00.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.567+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:45:00.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.575+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:45:00.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.579+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:00.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.583+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:00.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.599+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:45:00.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.607+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:45:00.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.619+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:00.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.639+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:45:00.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.643+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:00.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.659+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:00.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:00.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.671+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:45:00.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.683+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:00.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.703+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:45:00.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.703+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:45:00.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.719+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:45:00.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:00.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.747+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:45:00.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.751+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:45:00.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.759+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:00.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.763+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:00.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:45:00.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.803+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:45:00.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.823+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:45:00.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.823+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:45:00.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.839+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:00.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.847+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:00.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:45:00.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.851+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:45:00.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.879+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:45:00.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.891+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:45:00.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.895+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:00.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.899+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:45:00.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.919+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:45:00.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.927+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:45:00.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.939+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:00.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.947+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:00.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.951+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:00.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.971+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:45:00.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.975+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:45:00.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:00.987+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:01.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.007+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:01.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.011+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:45:01.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.027+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:45:01.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.043+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:45:01.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.051+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:01.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.051+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:45:01.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.063+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:45:01.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.075+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:45:01.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.087+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:01.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:45:01.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.127+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:45:01.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.135+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:01.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.151+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:01.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:01.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.167+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:45:01.172 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 195 16 2508077 2508061 803.79 814.375 0.00103634 0.00123225 2024-09-16T03:45:01.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.179+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:01.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.179+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:45:01.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.187+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:01.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.195+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:01.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.195+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:45:01.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.207+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:45:01.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.243+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:45:01.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.247+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:45:01.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.255+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:45:01.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.271+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:45:01.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.275+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:45:01.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.283+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:01.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.303+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:45:01.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:45:01.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.343+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:01.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.343+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:45:01.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.351+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:45:01.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.351+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:45:01.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.367+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:45:01.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.391+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:45:01.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.391+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:01.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.443+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:45:01.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:45:01.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:01.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.463+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:01.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.475+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:45:01.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.479+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:45:01.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.487+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:45:01.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.487+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:45:01.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.519+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:45:01.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.535+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:45:01.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:01.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.547+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:01.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:45:01.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.563+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:45:01.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.583+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:45:01.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.587+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:01.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.591+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:45:01.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.631+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:01.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:01.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.659+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:01.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:01.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.671+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:01.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:45:01.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.699+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:45:01.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.703+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:45:01.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.707+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:45:01.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.719+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:45:01.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.727+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:45:01.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.735+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:45:01.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:45:01.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:45:01.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.779+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:45:01.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.803+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:01.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:01.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.819+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:01.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.839+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:45:01.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.843+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:01.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.851+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:01.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.851+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:01.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.855+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:01.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.903+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:45:01.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:45:01.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:45:01.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.919+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:45:01.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.935+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:45:01.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.935+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:45:01.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:45:01.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.955+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:45:01.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.979+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:45:01.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:01.991+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:02.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.011+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:45:02.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.015+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:02.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.031+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:45:02.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.035+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:45:02.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.035+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:45:02.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.055+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:45:02.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.067+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:45:02.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.071+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:45:02.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.079+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:45:02.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.095+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:02.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.115+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:45:02.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:45:02.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.131+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:45:02.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.151+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:02.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.163+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:45:02.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 196 15 2520839 2520824 803.758 797.688 0.000869779 0.00123231 2024-09-16T03:45:02.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:02.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.187+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:45:02.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.195+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:45:02.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:45:02.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.203+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:02.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:45:02.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.243+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:02.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.251+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:02.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.255+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:45:02.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.279+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:02.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:02.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:45:02.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.295+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:45:02.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.303+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:45:02.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.303+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:45:02.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.315+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:45:02.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.319+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:02.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:45:02.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.339+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:02.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.355+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:45:02.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:45:02.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.367+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:45:02.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.371+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:45:02.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.391+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:45:02.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.431+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:45:02.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.435+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:45:02.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.443+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:45:02.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.459+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:45:02.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.459+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:45:02.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.471+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:02.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.479+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:45:02.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.495+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:45:02.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.503+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:45:02.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.503+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:45:02.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.515+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:45:02.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.539+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:45:02.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.547+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:45:02.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.559+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:45:02.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.559+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:45:02.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.567+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:45:02.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.579+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:02.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.595+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:45:02.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:02.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.607+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:45:02.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.631+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:45:02.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:45:02.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.639+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:02.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.655+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:45:02.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:45:02.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.695+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:45:02.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.707+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:45:02.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.707+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:45:02.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.719+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:02.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.723+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:02.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.723+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:02.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.727+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:45:02.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:02.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.767+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:45:02.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.771+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:45:02.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.799+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:45:02.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.803+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:45:02.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.803+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:02.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.815+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:45:02.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.819+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:45:02.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.835+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:45:02.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.851+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:45:02.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.859+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:45:02.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.863+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:02.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:45:02.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.895+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:45:02.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.915+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:45:02.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.915+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:45:02.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.931+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:45:02.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.943+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:02.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.943+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:02.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.951+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:02.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.959+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:02.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.971+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:45:02.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.975+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:45:02.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:02.987+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:03.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:45:03.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.043+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:45:03.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.051+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:03.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.087+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:03.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.095+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:45:03.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:45:03.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.111+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:45:03.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.115+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:45:03.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.115+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:45:03.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.147+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:03.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.163+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:03.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.167+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:45:03.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 197 16 2533392 2533376 803.66 784.5 0.000881597 0.00123246 2024-09-16T03:45:03.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:03.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.183+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:03.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.183+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:45:03.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:45:03.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.219+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:45:03.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.227+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:03.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:45:03.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.247+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:03.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.247+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:03.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:03.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.255+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:45:03.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.279+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:45:03.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.287+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:03.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.315+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:45:03.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.323+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:45:03.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.355+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:45:03.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.367+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:45:03.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.379+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:45:03.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.403+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:03.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:03.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.419+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:45:03.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.427+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:45:03.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.435+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:45:03.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.451+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:03.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.471+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:45:03.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.471+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:03.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:45:03.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.507+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:45:03.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.515+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:45:03.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.515+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:03.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.523+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:45:03.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.547+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:03.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.567+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:45:03.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.567+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:45:03.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.567+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:45:03.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.571+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:45:03.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.607+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:03.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.611+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:45:03.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.619+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:03.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:45:03.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.643+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:45:03.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.655+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:45:03.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:03.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.687+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:03.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.691+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:03.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.747+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:45:03.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.751+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:03.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.851+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:45:03.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.875+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:03.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.947+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:45:03.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.959+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:45:03.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.967+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:45:03.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.979+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:45:03.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:03.983+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:45:04.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.031+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:04.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.035+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:04.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.039+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:45:04.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.051+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:45:04.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.079+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:04.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.091+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:45:04.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.095+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:04.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.115+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:45:04.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.115+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:45:04.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.119+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:45:04.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.123+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:45:04.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 198 16 2543425 2543409 802.768 627.062 0.0472676 0.0012336 2024-09-16T03:45:04.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.187+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:45:04.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.195+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:45:04.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.203+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:45:04.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.207+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:04.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.231+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:04.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.259+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:04.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.259+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:04.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.263+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:04.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.271+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:04.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.271+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:04.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.323+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:45:04.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.323+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:04.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.339+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:45:04.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.351+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:45:04.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.359+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:04.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.367+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:45:04.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.375+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:45:04.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.375+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:45:04.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:04.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:45:04.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.427+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:04.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.431+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:45:04.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.431+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:45:04.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.447+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:04.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.459+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:45:04.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.467+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:45:04.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.467+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:04.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.479+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:45:04.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.495+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:45:04.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.499+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:04.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:04.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:04.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.519+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:04.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.563+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:04.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.595+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:04.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.619+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:04.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.627+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:45:04.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.635+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:04.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.663+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:04.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:04.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.683+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:45:04.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.687+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:04.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.695+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:04.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.715+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:04.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.723+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:45:04.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.727+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:45:04.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:45:04.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.751+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:45:04.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:45:04.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.783+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:45:04.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.787+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:45:04.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.799+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:45:04.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.811+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:45:04.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.823+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:04.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.839+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:04.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.875+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:45:04.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.887+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:45:04.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.911+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:45:04.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.919+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:45:04.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.923+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:45:04.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.927+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:45:04.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.959+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:04.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.967+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:45:04.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.979+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:45:04.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.991+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:45:05.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:04.999+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:05.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.011+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:45:05.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.015+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:45:05.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.043+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:45:05.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.047+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:45:05.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:05.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.055+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:05.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.083+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:05.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.095+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:45:05.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:05.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.103+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:45:05.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.115+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:45:05.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.131+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:05.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.139+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:45:05.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.139+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:45:05.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.155+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:45:05.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.159+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:05.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.167+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:05.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.171+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:45:05.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 199 16 2555872 2555856 802.643 777.938 0.000743004 0.00123402 2024-09-16T03:45:05.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.175+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:45:05.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.215+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:45:05.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:45:05.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:05.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.235+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:45:05.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.239+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:45:05.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.275+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:45:05.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.283+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:45:05.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:45:05.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:45:05.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.319+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:45:05.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.331+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:45:05.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:05.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.343+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:45:05.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.355+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:05.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.371+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:45:05.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.379+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:05.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.383+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:45:05.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.391+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:05.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.407+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:45:05.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.435+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:45:05.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.435+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:45:05.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.435+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:45:05.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.459+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:05.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.471+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:45:05.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.475+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:45:05.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.511+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:05.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.531+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:45:05.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.563+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:45:05.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:45:05.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.587+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:05.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.611+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:45:05.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.619+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:05.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.619+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:05.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.635+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:45:05.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.643+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:45:05.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.679+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:05.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.683+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:05.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.687+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:05.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.687+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:45:05.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.707+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:45:05.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.711+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:45:05.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.727+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:05.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.731+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:05.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.739+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:45:05.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.747+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:45:05.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:45:05.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.763+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:45:05.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:45:05.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.787+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:45:05.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.807+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:45:05.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.827+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:45:05.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:45:05.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:45:05.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.847+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:45:05.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.871+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:45:05.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.879+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:05.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:45:05.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.879+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:05.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.899+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:45:05.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.907+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:45:05.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.907+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:45:05.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.911+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:45:05.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.943+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:45:05.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.955+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:45:05.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.959+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:45:05.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.963+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:05.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.967+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:45:05.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:05.971+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:06.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.015+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:45:06.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.023+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:45:06.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.055+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:06.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.075+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:06.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.079+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:06.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.083+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:45:06.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.095+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:45:06.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.103+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:45:06.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.123+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:45:06.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.135+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:45:06.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.139+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:06.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.147+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:45:06.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.163+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:45:06.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:45:06.173185+0000 min lat: 0.000234761 max lat: 0.129137 avg lat: 0.00123407 2024-09-16T03:45:06.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:45:06.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 200 16 2568646 2568630 802.621 798.375 0.00105452 0.00123407 2024-09-16T03:45:06.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.187+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:06.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.191+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:06.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.195+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:45:06.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.203+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:45:06.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.243+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:45:06.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.247+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:45:06.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.263+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:45:06.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.263+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:45:06.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:45:06.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.279+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:45:06.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.295+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:06.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.299+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:06.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:45:06.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.343+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:06.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.355+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:45:06.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.371+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:06.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.387+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:45:06.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.391+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:45:06.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.395+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:45:06.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.415+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:45:06.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.415+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:45:06.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.419+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:06.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.427+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:06.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:45:06.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.459+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:45:06.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.467+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:45:06.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.475+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:06.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.499+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:45:06.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.507+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:45:06.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.515+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:45:06.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.519+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:06.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.547+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:45:06.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.555+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:45:06.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.571+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:45:06.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.575+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:06.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.595+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:06.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.603+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.607+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:06.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.615+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:45:06.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.627+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:45:06.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:06.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.655+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:45:06.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.659+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:45:06.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.663+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:06.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.667+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:45:06.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.671+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:45:06.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.683+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:45:06.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.691+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:06.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.719+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:45:06.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.739+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:45:06.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.747+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:06.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.747+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:45:06.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.771+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:06.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.779+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:45:06.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.791+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:06.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.823+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:06.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.835+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:45:06.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.843+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:06.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:45:06.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.859+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:45:06.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.859+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:45:06.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.863+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:45:06.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:45:06.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.911+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:06.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.911+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:06.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.931+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:45:06.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.947+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:06.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.963+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:06.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.967+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:45:06.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.983+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:45:06.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:06.991+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:45:07.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.023+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:45:07.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.027+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:07.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:45:07.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.067+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:45:07.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.067+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:07.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.071+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:45:07.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.071+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:07.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:45:07.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.091+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:07.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.111+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:45:07.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.115+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:45:07.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.159+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:45:07.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:45:07.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 201 16 2581755 2581739 802.704 819.312 0.000998481 0.00123394 2024-09-16T03:45:07.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:45:07.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:45:07.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.195+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:45:07.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.207+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:45:07.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.223+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:07.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.223+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:45:07.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.227+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:45:07.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.235+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:45:07.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.275+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:45:07.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:45:07.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.295+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:07.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.299+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:45:07.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.311+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:45:07.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.339+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:45:07.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.339+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:07.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.343+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:45:07.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.359+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:45:07.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.367+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:45:07.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:07.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.395+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:45:07.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.395+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:45:07.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.415+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:07.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.415+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:45:07.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.435+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:45:07.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:45:07.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.451+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:07.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.459+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:07.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.483+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:45:07.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.495+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:45:07.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.495+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:45:07.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:45:07.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.515+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:45:07.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.527+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:45:07.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.531+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:07.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.559+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:45:07.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.567+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:07.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.579+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:45:07.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:07.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.591+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:45:07.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.607+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:45:07.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.627+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:07.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:45:07.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.643+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:45:07.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.647+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:07.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.655+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:45:07.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.663+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:45:07.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:07.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.679+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:07.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.703+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:45:07.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.719+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:07.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.727+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:07.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:07.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.747+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:07.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.759+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:45:07.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.795+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:45:07.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.823+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:45:07.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.831+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:45:07.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.839+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:45:07.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.855+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:07.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:07.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.867+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:45:07.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.871+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:45:07.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.883+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:45:07.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.899+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:45:07.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.907+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:45:07.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.915+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:45:07.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.927+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:45:07.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.943+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:07.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.947+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:45:07.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.951+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:45:07.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.959+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:07.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:07.987+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:45:08.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.003+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:45:08.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.003+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:45:08.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.031+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:45:08.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.067+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:45:08.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.071+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:45:08.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.091+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:08.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.111+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:08.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.115+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:45:08.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.115+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:45:08.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.123+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:45:08.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.155+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:45:08.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.155+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:08.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.155+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:45:08.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 202 15 2594626 2594611 802.713 804.5 0.000590588 0.00123392 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.183+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.183+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.203+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.203+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.211+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.211+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.231+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:08.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.239+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:45:08.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.267+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:45:08.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:45:08.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.295+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:45:08.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.307+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:45:08.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.315+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:45:08.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:45:08.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.335+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:08.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.359+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:45:08.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.359+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:45:08.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:45:08.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.379+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:45:08.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.415+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:45:08.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.415+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:45:08.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.427+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:08.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.435+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:45:08.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:45:08.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:45:08.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.447+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:45:08.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.475+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:45:08.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.483+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:45:08.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.495+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:08.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.507+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:08.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.523+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:08.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.527+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:08.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.547+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:08.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.547+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:45:08.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.583+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:45:08.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.603+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:45:08.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.607+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:45:08.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.635+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:45:08.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.655+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:08.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.671+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:45:08.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.671+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:45:08.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.687+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:08.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.695+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:08.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.707+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:45:08.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.731+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:45:08.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:45:08.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.735+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:45:08.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.743+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:08.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:45:08.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:08.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.783+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:45:08.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.799+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:08.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.803+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:45:08.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.827+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:45:08.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.827+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:45:08.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.835+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:08.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.839+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:45:08.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.847+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:45:08.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.851+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:08.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.855+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:45:08.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.879+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:45:08.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:45:08.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:45:08.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.923+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:08.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.935+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:45:08.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.955+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:45:08.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.959+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:45:08.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.979+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:45:08.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.979+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:45:09.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.995+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:45:09.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:08.999+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:09.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.015+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:45:09.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:09.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.019+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:45:09.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.043+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:09.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.043+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:45:09.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.063+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:09.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.083+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:45:09.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:45:09.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.095+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:09.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:45:09.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:09.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.131+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:09.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:45:09.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:09.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.167+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:45:09.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 203 16 2607624 2607608 802.76 812.312 0.00116907 0.00123385 2024-09-16T03:45:09.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.187+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:45:09.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:09.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.191+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:09.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.207+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:45:09.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.235+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:45:09.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.239+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:09.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.251+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:09.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.259+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:09.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.267+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:45:09.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:45:09.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.327+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:45:09.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.327+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:45:09.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.335+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:45:09.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:09.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.367+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:45:09.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.387+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:09.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:09.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.395+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:45:09.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.395+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:45:09.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:45:09.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.423+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:45:09.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.423+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:09.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.435+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:45:09.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.439+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:45:09.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.447+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:45:09.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.467+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:45:09.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.479+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:45:09.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.503+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:09.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.515+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:45:09.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.531+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:09.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.531+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:45:09.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.559+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:45:09.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:45:09.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.583+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:45:09.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.583+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:09.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:09.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.607+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:45:09.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.607+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:45:09.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.619+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:09.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.635+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:45:09.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.651+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:45:09.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:45:09.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.703+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:45:09.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.703+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:45:09.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.707+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:09.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.719+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:45:09.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.731+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:45:09.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.739+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:45:09.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:09.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.747+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:45:09.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.779+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:09.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.799+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:09.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.819+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:45:09.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.819+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:09.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.819+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:45:09.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.831+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:45:09.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.843+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:45:09.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.851+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:45:09.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.879+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:45:09.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.895+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:45:09.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.903+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:09.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.927+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:09.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.931+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:45:09.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.943+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:45:09.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.947+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:45:09.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.967+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:45:09.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.975+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:45:09.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:09.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:45:10.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.007+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:45:10.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.023+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:10.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.035+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:10.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.039+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:45:10.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.051+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:10.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.063+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:10.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.079+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:45:10.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.083+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:45:10.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.087+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:45:10.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.095+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:45:10.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.123+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:45:10.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.127+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:45:10.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.135+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:45:10.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.135+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:45:10.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.163+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:10.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.167+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:45:10.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 204 16 2620862 2620846 802.88 827.375 0.00114671 0.00123367 2024-09-16T03:45:10.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.179+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:45:10.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.179+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:45:10.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:45:10.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.199+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:45:10.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.207+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:10.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.227+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:45:10.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.235+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:45:10.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.247+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:10.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:45:10.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.275+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:45:10.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.279+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:45:10.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.295+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:10.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.295+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:10.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.303+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:10.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.303+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:45:10.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.307+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:10.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.319+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:10.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.327+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:45:10.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:45:10.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:45:10.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:45:10.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.431+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:45:10.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.443+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:45:10.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.455+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:45:10.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.463+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:45:10.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.479+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:45:10.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.499+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:10.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.507+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:45:10.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.527+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:45:10.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.531+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:10.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.531+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:10.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.539+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:10.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:45:10.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.551+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:10.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.571+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:10.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.587+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:10.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.607+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:10.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.615+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:45:10.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.659+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:45:10.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.671+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:10.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.683+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:10.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.695+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:45:10.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.719+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:10.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.731+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:10.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:10.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.739+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:10.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:45:10.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.779+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:45:10.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.783+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:45:10.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.791+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:45:10.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.799+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:10.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.799+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:45:10.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.819+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:10.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:45:10.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.839+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:10.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.859+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:45:10.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:10.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.871+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:45:10.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.887+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:45:10.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.895+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:10.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.895+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:45:10.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.903+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:10.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.903+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:45:10.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.907+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:45:10.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.947+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:10.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:45:10.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.967+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:45:10.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.971+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:45:10.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:10.979+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:45:11.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.007+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:45:11.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.015+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:45:11.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.015+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:11.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.047+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:11.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.059+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:45:11.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.079+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:45:11.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:45:11.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.091+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:45:11.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.107+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:45:11.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.107+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:45:11.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.107+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:11.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.131+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:45:11.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.135+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:45:11.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.151+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:45:11.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.151+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:45:11.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.155+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:45:11.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 205 16 2633883 2633867 802.933 813.812 0.000376083 0.00123358 2024-09-16T03:45:11.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.179+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:11.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.179+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:45:11.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.179+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:45:11.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.199+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:11.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.203+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:11.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.215+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:45:11.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.243+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:11.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.247+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:11.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.251+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:45:11.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.267+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:45:11.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.271+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:11.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.275+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:45:11.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.295+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:11.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.319+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:11.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.331+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:11.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.335+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:45:11.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.355+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:11.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.359+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:11.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.379+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:45:11.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.387+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:45:11.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.411+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:11.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:11.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.431+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:45:11.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.431+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:45:11.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:45:11.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.459+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:45:11.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.467+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:45:11.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.471+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:11.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.475+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:45:11.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.475+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:45:11.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.487+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:45:11.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.523+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:45:11.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.539+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:45:11.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.547+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:11.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.547+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:45:11.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.555+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:11.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.559+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:45:11.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.587+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:11.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.595+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:45:11.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.607+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:45:11.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.627+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:11.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:45:11.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.659+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:45:11.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.671+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:45:11.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.671+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:45:11.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.691+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:45:11.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.695+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:11.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.711+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:45:11.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:45:11.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:45:11.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.755+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:11.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.759+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:11.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.763+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:45:11.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:45:11.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.783+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:45:11.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:45:11.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.815+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:11.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.823+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:45:11.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.827+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:45:11.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.839+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:45:11.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.871+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:11.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.879+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:11.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.895+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:45:11.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.907+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:11.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.931+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:45:11.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.939+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:45:11.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.951+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:45:11.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.963+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:45:11.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.983+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:45:11.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.987+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:45:11.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:11.987+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:45:12.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.031+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:12.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.031+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:45:12.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.031+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:45:12.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.039+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:45:12.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.071+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:45:12.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.087+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:45:12.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.087+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:45:12.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:45:12.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.119+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:45:12.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:45:12.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.139+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:45:12.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.147+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:45:12.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.155+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:45:12.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.163+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:45:12.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 206 16 2646928 2646912 802.993 815.312 0.000512725 0.00123348 2024-09-16T03:45:12.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.203+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:45:12.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.215+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:12.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.223+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:45:12.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:45:12.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.251+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:45:12.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.251+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:45:12.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:12.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.267+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:12.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.291+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:12.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.291+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:45:12.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.315+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:45:12.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.315+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:12.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.331+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:45:12.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.331+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:45:12.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.347+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:12.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.355+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:45:12.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.359+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:45:12.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.359+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:45:12.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.371+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:12.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.403+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:45:12.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.419+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:45:12.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.423+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:45:12.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:12.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.451+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:45:12.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.455+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:12.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.511+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:12.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.519+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:45:12.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:12.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.539+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:12.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.543+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:45:12.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.551+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:45:12.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.595+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:12.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.595+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:12.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.623+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:45:12.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.627+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:45:12.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.651+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:45:12.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.655+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:45:12.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.659+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:45:12.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.663+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:45:12.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:12.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.687+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:45:12.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.699+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:45:12.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.703+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:45:12.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.707+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:45:12.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:12.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.735+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:45:12.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.747+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:45:12.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.747+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:12.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:12.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.771+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:45:12.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:45:12.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.803+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:45:12.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.831+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:45:12.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.843+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:45:12.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.859+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:45:12.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.863+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:45:12.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.883+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:12.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.899+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:45:12.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.899+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:12.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.927+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:45:12.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:12.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.939+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:45:12.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:12.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.959+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:45:12.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.963+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:45:12.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.983+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:45:12.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.987+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:12.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.991+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:45:12.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:12.995+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:45:13.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.027+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:45:13.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.035+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:45:13.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.075+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:13.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.075+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:45:13.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.087+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:45:13.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.127+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:45:13.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.135+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:13.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.151+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:45:13.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.151+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:45:13.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.171+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:45:13.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 207 15 2660151 2660136 803.106 826.5 0.000995582 0.00123331 2024-09-16T03:45:13.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:45:13.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.199+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:45:13.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.199+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:45:13.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:13.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.235+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:45:13.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.251+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:45:13.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.267+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:45:13.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.271+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:45:13.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:45:13.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.299+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:45:13.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:13.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:13.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.375+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:45:13.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.383+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:13.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:13.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:45:13.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.435+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:13.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.443+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:13.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.463+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:45:13.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.463+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:13.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.467+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:45:13.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.467+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:13.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.487+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:45:13.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.495+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:45:13.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.499+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:45:13.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.515+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:45:13.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.543+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:13.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.551+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:45:13.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.567+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:45:13.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.575+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:13.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.611+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:45:13.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:45:13.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:13.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.651+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:45:13.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.659+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:45:13.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.695+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:45:13.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.699+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:13.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.707+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:45:13.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.719+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:45:13.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.723+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:45:13.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.731+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:13.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.759+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:13.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.763+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:45:13.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.767+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:45:13.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.775+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:45:13.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.779+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:13.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.779+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:13.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.799+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:45:13.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.815+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:13.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.815+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:13.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.855+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:13.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.871+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:45:13.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.875+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:45:13.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.875+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:13.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.879+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:45:13.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.895+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:45:13.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.903+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:45:13.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.919+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:13.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:45:13.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.927+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:45:13.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.947+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:45:13.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.947+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:13.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.947+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:45:13.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.955+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:45:13.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.983+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:45:13.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:13.991+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:14.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.011+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:45:14.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.015+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:14.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.099+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:45:14.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.111+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:45:14.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.139+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:14.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.151+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:14.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.159+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:14.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.167+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:45:14.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.171+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:45:14.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 208 16 2672245 2672229 802.878 755.812 0.000643667 0.00123367 2024-09-16T03:45:14.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.251+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:14.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.259+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:45:14.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.307+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:45:14.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.311+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:45:14.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.323+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:14.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.339+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:14.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:45:14.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:45:14.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:45:14.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.395+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:45:14.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.403+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:45:14.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.407+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:45:14.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.415+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:14.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:45:14.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.451+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:14.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.451+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:14.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.487+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:45:14.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.487+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:45:14.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.491+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:45:14.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.503+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:14.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.539+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:14.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.555+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:14.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.559+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:45:14.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:45:14.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.583+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:45:14.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.591+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:45:14.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.615+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:45:14.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.619+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:14.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:45:14.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:45:14.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.675+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:45:14.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.683+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:45:14.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.687+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:14.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.707+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:45:14.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.723+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:14.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.731+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:45:14.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.747+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:45:14.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.747+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:45:14.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.755+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:45:14.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:45:14.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:45:14.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.783+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:45:14.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.799+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:14.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.803+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:14.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.831+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:45:14.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.839+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:45:14.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.855+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:45:14.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.867+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:14.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.883+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:14.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.887+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:45:14.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.911+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:14.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.923+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:45:14.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.923+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:45:14.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.931+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:45:14.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.935+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:14.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.943+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:45:14.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.955+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:45:14.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.979+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:45:14.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.983+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:45:14.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.991+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:14.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.995+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:45:15.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.999+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:45:15.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:14.999+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:45:15.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.015+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:45:15.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:15.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.039+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:45:15.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.039+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:45:15.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.047+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:45:15.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.067+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:45:15.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.083+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:45:15.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.095+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:45:15.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.111+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:45:15.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.115+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:45:15.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.147+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:15.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.151+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:45:15.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.167+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:45:15.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 209 16 2683723 2683707 802.469 717.375 0.000795823 0.00123429 2024-09-16T03:45:15.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.175+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:45:15.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.183+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:45:15.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.195+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:15.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.199+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:15.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.211+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:45:15.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.223+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:15.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.235+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:15.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.239+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:15.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.255+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:15.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.263+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:15.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.263+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:45:15.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:45:15.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:45:15.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.307+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:45:15.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.319+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:45:15.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.327+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:15.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.335+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:45:15.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.343+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:15.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.351+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:45:15.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.355+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:45:15.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.367+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:15.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.383+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:15.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.387+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:15.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.395+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:45:15.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.411+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:45:15.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.415+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:15.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.427+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:15.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.427+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:45:15.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.451+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:45:15.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.467+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:15.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:45:15.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.479+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:45:15.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.487+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:45:15.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.491+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:45:15.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.499+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:45:15.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.535+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:45:15.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.547+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:15.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:15.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.571+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:15.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.575+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:15.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.579+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:45:15.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.591+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:45:15.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.599+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:15.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:45:15.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.631+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:15.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:45:15.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.659+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:45:15.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.675+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:45:15.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.679+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:15.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.703+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:45:15.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.715+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:45:15.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.731+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:45:15.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.771+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:45:15.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:15.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.775+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:45:15.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:15.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.799+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:45:15.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.799+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:15.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.827+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:45:15.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.847+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:45:15.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.859+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:15.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.871+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:45:15.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.887+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:45:15.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.891+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:45:15.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.899+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:15.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.923+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:45:15.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.931+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:15.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.943+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:45:15.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.959+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:45:15.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:15.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.979+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:45:15.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.987+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:45:15.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.987+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:45:15.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.987+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:45:16.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:15.999+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:16.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.011+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:45:16.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.035+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:45:16.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.039+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:45:16.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.039+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:16.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.055+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:45:16.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.095+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:45:16.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.099+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:16.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.099+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:45:16.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:45:16.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.115+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:45:16.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.143+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:45:16.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.143+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:45:16.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.151+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:45:16.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:16.173 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 210 16 2696588 2696572 802.476 804.062 0.00100531 0.00123429 2024-09-16T03:45:16.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.171+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:16.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.179+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:45:16.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.187+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:16.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.199+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:16.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:45:16.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.227+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:16.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.231+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:16.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.251+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:16.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.271+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:45:16.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.287+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:45:16.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.295+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:45:16.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.307+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:45:16.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.323+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:45:16.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.335+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:45:16.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.363+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:45:16.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.371+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:45:16.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.383+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:16.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.387+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:45:16.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.403+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:45:16.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.403+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:45:16.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.407+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:45:16.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.427+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:45:16.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:45:16.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.443+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:45:16.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:45:16.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.459+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:45:16.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.463+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:45:16.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.471+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:16.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.499+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:16.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.503+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:45:16.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.547+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:45:16.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.551+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:45:16.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:45:16.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.591+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:16.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.615+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:16.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.639+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:45:16.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.647+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:45:16.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.683+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:16.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.687+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:45:16.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.699+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:45:16.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.699+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:45:16.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.699+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:16.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.711+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:45:16.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.743+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:45:16.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.775+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:45:16.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.787+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:45:16.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.799+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:16.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.799+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:45:16.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.803+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:45:16.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.811+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:45:16.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.819+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:45:16.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.843+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:45:16.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.851+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:45:16.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.859+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:45:16.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.859+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:45:16.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:45:16.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.891+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:45:16.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.915+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:45:16.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.923+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:16.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.943+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:45:16.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.947+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:45:16.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.975+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:45:16.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.979+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:45:16.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.995+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:45:17.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:16.999+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:45:17.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.023+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:45:17.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.023+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:45:17.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.027+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:17.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.039+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:17.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:45:17.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.051+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:17.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.075+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:17.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.079+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:45:17.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.091+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:45:17.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.103+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:17.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:45:17.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.123+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:17.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.123+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:45:17.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.135+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:45:17.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.151+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:17.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.171+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:17.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 211 16 2709864 2709848 802.605 829.75 0.000720796 0.00123409 2024-09-16T03:45:17.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.187+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:45:17.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.187+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:17.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.191+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:17.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.207+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:45:17.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.207+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:45:17.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.219+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:45:17.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.219+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:17.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.223+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:17.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.247+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:17.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.263+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:45:17.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.283+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:45:17.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.295+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:45:17.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.299+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:17.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.319+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:45:17.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.323+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:17.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.331+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:17.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.335+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:17.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.391+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:17.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:45:17.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.411+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:17.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.423+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:45:17.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.427+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:17.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.443+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:45:17.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.463+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:17.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:45:17.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.471+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:45:17.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.487+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:17.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.507+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:45:17.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.519+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:45:17.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.531+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:17.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.543+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:45:17.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.551+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:17.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.571+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:17.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.595+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:45:17.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.639+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:17.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.639+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:45:17.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.655+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:45:17.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.655+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:45:17.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.687+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:45:17.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.699+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:45:17.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.711+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:17.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.723+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:45:17.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.747+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:17.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.763+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:45:17.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.771+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:45:17.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.775+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:17.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.795+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:17.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.815+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:17.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:45:17.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.839+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:17.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.851+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:45:17.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.875+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:45:17.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.891+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:17.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.899+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:45:17.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.919+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:45:17.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.923+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:45:17.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.931+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:45:17.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.939+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:17.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:45:17.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.963+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:45:17.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.963+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:17.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.983+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:18.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:17.995+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:45:18.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.007+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:45:18.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.019+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:45:18.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.023+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:45:18.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.035+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:18.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.035+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:45:18.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.063+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:45:18.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.071+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:18.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.079+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:18.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.087+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:18.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.087+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:45:18.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.095+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:18.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.107+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:45:18.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.123+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:45:18.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.131+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:18.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.135+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:45:18.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.139+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:45:18.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.143+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:45:18.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.147+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:18.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 212 15 2722896 2722881 802.661 814.562 0.000537374 0.00123398 2024-09-16T03:45:18.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.175+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:45:18.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.179+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:18.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.195+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:45:18.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.195+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:18.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.203+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:45:18.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.215+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:45:18.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.227+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:45:18.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.243+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:45:18.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.251+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:45:18.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.259+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:18.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:45:18.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.307+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:45:18.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.311+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:18.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.315+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:45:18.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.319+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:18.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.347+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:18.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.347+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:45:18.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.351+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:45:18.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.359+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:18.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.363+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:45:18.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.375+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:45:18.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:18.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:45:18.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.427+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:18.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.439+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:18.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.451+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:18.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.467+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:45:18.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:45:18.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.479+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:18.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.479+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:45:18.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.499+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:45:18.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.507+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:18.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.511+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:18.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.539+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:45:18.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.555+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:45:18.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:45:18.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.575+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:45:18.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:45:18.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:45:18.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.607+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:18.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.627+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:18.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.631+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:45:18.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.631+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:45:18.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.643+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:18.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:45:18.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.671+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:45:18.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.695+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:45:18.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.711+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:45:18.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.715+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:45:18.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.719+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:45:18.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.735+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:45:18.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.771+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:18.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.775+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:18.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.787+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:45:18.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:18.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.791+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:45:18.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.799+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:18.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.827+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:45:18.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.843+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:18.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.847+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:45:18.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.855+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:45:18.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.859+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:45:18.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.875+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:45:18.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.879+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:18.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.883+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:18.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.887+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:45:18.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:18.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.919+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:45:18.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.931+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:45:18.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.943+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:45:18.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.983+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:18.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.983+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:45:18.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:18.991+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:45:19.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.019+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:45:19.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.039+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:45:19.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.039+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:45:19.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.043+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:45:19.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.055+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:45:19.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.055+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:19.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.063+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:45:19.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.075+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:19.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.095+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:45:19.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.095+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:19.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.103+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:45:19.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.107+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:45:19.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 213 16 2735433 2735417 802.571 783.5 0.000742679 0.00123407 2024-09-16T03:45:19.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.175+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:45:19.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.199+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:45:19.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.207+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:45:19.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.211+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:45:19.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.211+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:19.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:19.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.231+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:19.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.271+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:19.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.287+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:45:19.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.287+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:19.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:45:19.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.299+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:45:19.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.311+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:19.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.339+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:19.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.339+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:19.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.347+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:19.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.375+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:45:19.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:45:19.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.411+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:45:19.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.415+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:19.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.427+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:45:19.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.435+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:19.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.447+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:19.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.447+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:45:19.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:19.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.475+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:19.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.487+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:45:19.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.491+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:45:19.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.503+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:45:19.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.511+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:45:19.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.515+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:19.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.523+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:45:19.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.555+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:45:19.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.563+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:45:19.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.563+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:19.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.583+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:45:19.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.595+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:19.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:19.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:19.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.631+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:45:19.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.631+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:45:19.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.631+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:19.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.647+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:45:19.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.667+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:19.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.671+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:19.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.687+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:45:19.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.711+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:45:19.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.715+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:45:19.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.719+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:19.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.727+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:45:19.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.743+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:45:19.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:45:19.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.779+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:45:19.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.779+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:45:19.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.779+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:45:19.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:45:19.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.803+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:45:19.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.803+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:45:19.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.811+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:19.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:45:19.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.843+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:45:19.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.859+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:19.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.867+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:45:19.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.883+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:45:19.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.899+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:19.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.899+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:45:19.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.899+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:45:19.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.903+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:19.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.935+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:45:19.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.935+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:19.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.959+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:45:19.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.971+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:45:19.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.979+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:45:19.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.995+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:45:20.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:19.999+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:45:20.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.023+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:20.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.035+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:45:20.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.043+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:45:20.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:45:20.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.047+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:45:20.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.091+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:20.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.099+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:45:20.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.119+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:45:20.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.123+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:45:20.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.139+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:20.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.139+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:45:20.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.163+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:45:20.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.167+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:45:20.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 214 15 2748705 2748690 802.697 829.562 0.000501848 0.00123394 2024-09-16T03:45:20.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.187+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:45:20.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.187+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:45:20.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:20.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:20.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.227+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:20.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.231+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:45:20.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.251+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:20.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.263+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:45:20.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.267+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:20.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.287+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:45:20.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.291+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:45:20.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.303+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:20.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.307+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:20.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.331+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:45:20.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.335+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:20.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.359+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:20.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:45:20.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.371+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:45:20.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.391+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:45:20.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.415+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:20.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.423+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:45:20.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.431+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:20.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:45:20.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:45:20.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.455+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:45:20.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.479+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:20.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.479+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:45:20.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.495+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:45:20.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.503+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:45:20.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.523+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:20.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.535+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:45:20.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.535+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:20.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.555+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:45:20.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.559+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:20.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.575+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:20.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.579+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:20.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.595+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:45:20.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.611+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:20.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.623+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:45:20.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.635+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:45:20.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.643+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:45:20.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.647+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:45:20.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.663+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:45:20.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.663+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:45:20.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.687+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:20.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.687+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:45:20.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.695+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:20.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.695+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:45:20.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.707+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:20.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.727+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:45:20.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.743+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:45:20.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.751+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:20.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.767+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:20.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.771+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:45:20.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.779+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:20.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.783+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:45:20.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.791+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:45:20.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.795+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:45:20.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.811+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:45:20.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.811+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:45:20.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.827+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:20.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.851+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:45:20.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.875+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:45:20.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.875+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:45:20.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.887+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:45:20.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.887+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:45:20.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.915+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:45:20.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.919+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:45:20.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.931+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:45:20.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.947+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:45:20.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:45:20.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.975+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:45:20.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:20.983+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:45:21.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.015+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:45:21.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.015+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:45:21.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.043+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:45:21.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.055+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:45:21.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.079+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:21.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.083+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:21.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.087+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:45:21.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.091+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:45:21.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.095+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:45:21.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.147+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:21.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.155+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:21.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.155+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:45:21.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 215 16 2762000 2761984 802.827 830.875 0.00427611 0.00123374 2024-09-16T03:45:21.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.171+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:21.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.183+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:21.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.191+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:21.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.191+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:45:21.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.199+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:21.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.227+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:45:21.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.239+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:21.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.251+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:45:21.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.259+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:21.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.275+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:45:21.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.307+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:45:21.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.307+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:45:21.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:45:21.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.331+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:21.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.335+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:21.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.343+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:45:21.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.363+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:45:21.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:21.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.379+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:45:21.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.387+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:45:21.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:21.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:45:21.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.423+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:45:21.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.435+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:45:21.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.447+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:21.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.447+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:45:21.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:45:21.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.471+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:45:21.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.495+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:21.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.507+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:45:21.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.519+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:45:21.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.527+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:45:21.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.535+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:45:21.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.539+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:21.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.575+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:21.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:21.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.595+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:21.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.595+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:45:21.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:45:21.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.611+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:45:21.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.619+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:45:21.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.623+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:21.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:45:21.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.635+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:21.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.663+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:21.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.679+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:45:21.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.691+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:21.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.699+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:45:21.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.707+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:45:21.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.715+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:21.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.731+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:45:21.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.751+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:45:21.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.755+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:45:21.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.787+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:45:21.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.787+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:45:21.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:21.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.819+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:45:21.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.819+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:45:21.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.827+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:21.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.839+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:45:21.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.843+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:21.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.851+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:21.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.859+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:45:21.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.875+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:21.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.891+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:45:21.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.919+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:21.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.923+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:21.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:21.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.939+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:45:21.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.947+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:45:21.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.971+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:45:22.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.999+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:22.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:21.999+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:45:22.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.031+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:22.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.039+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:22.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.055+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:22.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.067+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:45:22.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.071+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:22.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.071+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:22.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.075+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:45:22.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.083+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:45:22.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.115+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:45:22.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.123+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:22.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.135+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:22.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.143+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:45:22.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.159+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:45:22.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 216 15 2775036 2775021 802.882 814.812 0.000846689 0.00123365 2024-09-16T03:45:22.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.171+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:45:22.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.175+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:22.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.179+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:22.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.187+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:45:22.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.207+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:22.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.215+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:22.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.231+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:22.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:22.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.267+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:45:22.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.279+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:22.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.279+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:22.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.299+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:45:22.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.303+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:22.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.315+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:45:22.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.331+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:22.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.331+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:22.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.343+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:45:22.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.371+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:45:22.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.375+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:22.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.395+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:45:22.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.407+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:45:22.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.411+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:45:22.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.419+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:45:22.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.427+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:45:22.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.427+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:45:22.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.439+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:45:22.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.455+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:45:22.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.463+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:45:22.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:45:22.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.483+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:45:22.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.491+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:22.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.507+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:22.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.515+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:22.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.523+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:45:22.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.527+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:22.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.535+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:45:22.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.539+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:45:22.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.563+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:45:22.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.571+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:22.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.575+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:45:22.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.583+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:22.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:45:22.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.619+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:45:22.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:45:22.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.643+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:22.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.659+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:45:22.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.667+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:45:22.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.679+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:45:22.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.691+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:45:22.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.731+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:45:22.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.735+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:45:22.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.751+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:22.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.763+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:45:22.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.775+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:45:22.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.787+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:45:22.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.799+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:45:22.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.815+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:22.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.827+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:45:22.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.847+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:22.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:45:22.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.899+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:45:22.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.915+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:22.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.915+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:22.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.919+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:45:22.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.919+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:45:22.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.935+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:45:22.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.971+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:22.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.975+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:45:22.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:22.983+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:45:23.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.003+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:23.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.031+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:23.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.043+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:45:23.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.051+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:45:23.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.071+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:23.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.075+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:45:23.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.079+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:45:23.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.087+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:45:23.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.107+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:45:23.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.127+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:45:23.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.131+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:45:23.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.143+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:23.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.159+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:45:23.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.159+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:45:23.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 217 16 2788374 2788358 803.023 833.562 0.00148862 0.00123344 2024-09-16T03:45:23.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.175+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:45:23.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.183+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:45:23.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.187+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:45:23.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.203+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:45:23.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.203+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:23.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.215+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:45:23.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.223+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:45:23.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.239+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:45:23.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.243+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:45:23.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.255+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:23.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.275+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:45:23.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:45:23.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.283+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:45:23.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.303+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:45:23.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.311+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:23.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.331+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:45:23.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.339+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:23.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.339+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:45:23.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.351+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:45:23.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:45:23.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.383+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:45:23.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.383+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:45:23.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.403+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:45:23.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.407+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:23.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.419+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:45:23.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.423+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:45:23.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.439+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:23.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.443+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:23.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.471+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:45:23.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.483+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:23.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.503+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:45:23.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.535+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:45:23.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.543+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:23.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.551+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:45:23.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.555+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:45:23.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.571+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:45:23.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.595+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:45:23.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.599+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:23.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:45:23.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.619+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:45:23.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.623+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:45:23.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.639+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:23.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.663+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:23.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.683+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:23.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.691+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:45:23.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.695+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:23.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.699+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:45:23.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.707+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:45:23.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.719+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:45:23.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.731+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:45:23.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:45:23.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.743+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:45:23.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.759+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:23.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.771+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:45:23.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.775+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:23.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.779+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:45:23.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.787+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:23.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.823+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:45:23.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.835+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:23.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.843+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:23.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:45:23.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.859+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:23.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.867+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:23.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.871+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:45:23.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.879+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:45:23.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.899+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:45:23.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.903+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:45:23.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.907+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:45:23.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.943+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:45:23.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.955+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:23.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.959+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:45:23.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.975+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:45:23.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.975+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:45:23.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:23.983+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:45:24.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.007+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:45:24.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.011+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:45:24.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.019+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:45:24.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.023+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:45:24.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.039+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:45:24.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.051+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:45:24.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.051+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:45:24.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:24.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.123+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:45:24.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.123+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:24.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.127+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:45:24.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.131+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:45:24.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.155+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:24.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.163+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:45:24.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.167+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:45:24.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.167+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:45:24.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 218 16 2800858 2800842 802.919 780.25 0.000645943 0.00123359 2024-09-16T03:45:24.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.191+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:24.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.211+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:45:24.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.215+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:45:24.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.219+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:45:24.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.251+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:45:24.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.255+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:45:24.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.263+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:45:24.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.271+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:45:24.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.287+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:45:24.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.295+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:24.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.307+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:24.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.319+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:45:24.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.319+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:24.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.339+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:24.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.343+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:45:24.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.363+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:45:24.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.363+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:45:24.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.387+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:45:24.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.387+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:24.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.399+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:45:24.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.415+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:45:24.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.427+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:45:24.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.427+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:45:24.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.427+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:45:24.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.427+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:45:24.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.439+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:24.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.451+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:24.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.455+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:45:24.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.463+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:45:24.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:45:24.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.487+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:45:24.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.511+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:24.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.527+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:45:24.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.547+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:45:24.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:45:24.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:24.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.559+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:45:24.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.579+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:24.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.595+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:24.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.611+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:45:24.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.611+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:45:24.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.615+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:45:24.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.623+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:24.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.647+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:24.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.655+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:45:24.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.655+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:45:24.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.667+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:24.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.667+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:24.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.691+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:45:24.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.703+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:45:24.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.723+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:45:24.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.747+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:24.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.767+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:45:24.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.771+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:45:24.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.775+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:24.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.787+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:45:24.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.811+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:45:24.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.815+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:45:24.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.827+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:45:24.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.847+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:45:24.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.851+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:45:24.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.871+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:45:24.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.891+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:45:24.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.927+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:45:24.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:45:24.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.931+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:24.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.955+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:24.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.991+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:24.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:24.991+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:45:25.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.015+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:45:25.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.019+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:25.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.027+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:25.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.043+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:45:25.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.055+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:45:25.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.063+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:45:25.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.067+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:45:25.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.067+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:45:25.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.071+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:45:25.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.115+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:25.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.119+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:45:25.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.139+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:45:25.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.147+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:25.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.167+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:25.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 219 16 2813630 2813614 802.897 798.25 0.00355905 0.00123364 2024-09-16T03:45:25.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.175+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:45:25.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.179+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:45:25.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.203+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:25.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.203+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:45:25.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.227+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:25.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.227+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:45:25.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.239+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:45:25.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.275+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:25.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.279+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:45:25.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.287+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:25.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.291+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:25.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.291+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:45:25.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.303+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:45:25.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.335+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:25.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.335+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:25.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.335+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:25.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:45:25.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.343+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:25.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.375+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:25.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.379+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:45:25.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.383+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:45:25.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.407+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:45:25.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.407+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:25.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.411+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:45:25.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.419+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:45:25.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.423+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:25.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.435+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:45:25.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.439+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:25.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.463+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:25.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.487+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:45:25.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.495+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:45:25.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.499+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:25.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.511+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:45:25.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.515+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:45:25.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.531+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:45:25.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.563+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:45:25.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.567+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:25.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.575+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:45:25.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.595+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:45:25.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.599+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:45:25.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.619+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:45:25.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.627+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:25.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.627+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:45:25.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.655+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:45:25.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.659+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:45:25.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.683+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:45:25.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.691+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:45:25.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.695+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:45:25.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.695+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:25.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.715+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:45:25.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.727+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:45:25.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.739+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:45:25.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.759+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:45:25.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.763+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:45:25.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.775+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:45:25.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.775+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:25.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.783+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:45:25.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.791+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:25.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.799+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:45:25.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.823+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:25.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.839+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:25.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.855+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:45:25.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.863+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:25.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.879+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:25.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.887+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:45:25.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.899+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:25.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.911+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:45:25.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.927+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:45:25.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.931+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:25.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.931+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:45:25.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.943+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:45:25.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.959+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:45:25.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.979+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:25.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.987+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:45:25.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:25.995+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:26.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.027+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:45:26.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.035+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:26.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.043+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:45:26.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.047+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:45:26.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.047+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:45:26.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.059+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:45:26.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.063+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:45:26.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.103+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:45:26.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.103+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:26.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.111+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:45:26.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.115+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:26.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.151+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:26.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.163+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:26.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:45:26.174957+0000 min lat: 0.000234761 max lat: 0.129137 avg lat: 0.0012336 2024-09-16T03:45:26.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:45:26.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 220 16 2826571 2826555 802.923 808.812 0.00106458 0.0012336 2024-09-16T03:45:26.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.175+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:45:26.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.179+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:26.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.187+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:45:26.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.199+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:45:26.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.199+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:45:26.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.211+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:45:26.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.227+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:45:26.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.239+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:45:26.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.275+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:26.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.275+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:26.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.279+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:45:26.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:26.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.303+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:45:26.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.315+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:45:26.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.331+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:45:26.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.351+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:45:26.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.351+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:45:26.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.371+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:26.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.379+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:45:26.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.383+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:45:26.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.387+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:45:26.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.411+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:26.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.411+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:45:26.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.427+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:45:26.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.431+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:45:26.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.459+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:26.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.467+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:45:26.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.479+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:45:26.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.491+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:45:26.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.491+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:45:26.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.495+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:26.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.503+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:45:26.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.515+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:26.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.535+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:45:26.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.535+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:45:26.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.547+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:45:26.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.559+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:45:26.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.571+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:45:26.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.583+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:26.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.591+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:26.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.603+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:45:26.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.611+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:26.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.627+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:45:26.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.635+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:26.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.635+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:45:26.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.643+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:26.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.647+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:26.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.667+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:45:26.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.679+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:26.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.691+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:45:26.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.699+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:45:26.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.715+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:26.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.755+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:26.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.763+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:45:26.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.803+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:45:26.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.811+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:45:26.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.815+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:45:26.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.843+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:45:26.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.847+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:45:26.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.851+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:26.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.851+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:26.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.863+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:45:26.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.891+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:26.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.899+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:45:26.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.903+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:26.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.911+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:45:26.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.951+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:26.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.955+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:45:26.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.975+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:26.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:26.983+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:45:27.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.003+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:45:27.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.007+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:27.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.019+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:45:27.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.027+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:45:27.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.043+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:45:27.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.047+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:45:27.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.051+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:27.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.071+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:45:27.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.071+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:45:27.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.095+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:45:27.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.099+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:45:27.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.127+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:27.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.131+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:45:27.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.151+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:27.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.159+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:45:27.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 221 15 2839456 2839441 802.934 805.375 0.00122289 0.00123358 2024-09-16T03:45:27.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.171+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:27.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.175+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:27.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.191+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:45:27.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.203+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:45:27.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.207+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:45:27.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.215+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:27.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.227+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:27.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.235+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:27.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.239+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:27.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.255+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:45:27.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.267+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:45:27.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.287+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:45:27.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.291+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:45:27.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.295+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:27.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.319+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:45:27.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.335+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:27.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.339+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:45:27.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.343+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:45:27.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.347+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:45:27.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.347+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:45:27.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.351+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:27.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.363+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:45:27.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:45:27.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.399+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:45:27.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.403+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:45:27.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.411+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:45:27.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.419+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:45:27.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.427+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:45:27.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.427+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:45:27.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.439+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:45:27.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.467+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:27.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.467+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:45:27.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.487+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:27.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.491+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:45:27.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.503+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:45:27.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.503+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:45:27.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.523+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:45:27.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.527+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:27.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.531+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:45:27.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.547+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:27.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.555+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:45:27.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.571+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:27.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.603+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:45:27.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.603+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:45:27.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.607+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:45:27.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.623+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:45:27.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.635+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:27.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.659+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:45:27.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.675+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:45:27.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.683+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:45:27.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.687+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:27.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.699+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:45:27.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.711+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:45:27.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.711+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:45:27.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.715+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:27.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.727+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:45:27.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.731+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:45:27.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:45:27.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.743+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:45:27.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.799+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:45:27.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.823+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:27.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.839+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:27.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.847+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:27.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.855+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:27.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.871+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:45:27.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.871+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:27.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.879+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:45:27.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.895+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:45:27.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.899+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:27.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.911+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:45:27.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.919+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:45:27.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.919+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:45:27.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.935+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:45:27.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.951+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:45:27.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.963+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:27.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.967+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:45:27.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:27.983+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:28.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.003+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:28.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.011+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:28.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.027+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:45:28.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.031+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:45:28.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.035+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:45:28.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.055+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:45:28.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.059+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:28.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.083+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:45:28.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.095+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:28.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.103+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:45:28.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.119+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:28.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.127+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:28.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.135+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:45:28.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.159+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:45:28.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.163+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:45:28.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 222 16 2852438 2852422 802.972 811.312 0.000535072 0.00123352 2024-09-16T03:45:28.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.183+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:45:28.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.183+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:45:28.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.195+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:45:28.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.215+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:28.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.223+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:28.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.239+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:45:28.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.251+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:45:28.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.267+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:45:28.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.299+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:45:28.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.307+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:45:28.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.311+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:45:28.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.315+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:28.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.323+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:28.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.347+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:28.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.359+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:28.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.363+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:45:28.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.367+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:45:28.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.367+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:45:28.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.379+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:45:28.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.391+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:45:28.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.399+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:45:28.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.411+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:45:28.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.435+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:28.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.447+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:28.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.447+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:28.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.459+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:45:28.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.475+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:45:28.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.479+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:28.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.495+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:45:28.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.511+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:45:28.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.519+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:45:28.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.523+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:28.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.543+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:45:28.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.543+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:45:28.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.551+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:45:28.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.555+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:28.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.563+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:45:28.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.579+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:45:28.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.583+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:45:28.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.595+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:45:28.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.599+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:28.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.603+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:28.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.615+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:45:28.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.623+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:28.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.635+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:45:28.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.651+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:28.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.671+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:45:28.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.699+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:28.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.699+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:28.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.719+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:45:28.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.727+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:45:28.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.739+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:45:28.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.739+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:28.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.751+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:28.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.763+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:45:28.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.779+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:45:28.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.783+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:45:28.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.783+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:45:28.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.787+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:45:28.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.795+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:28.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.807+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:45:28.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.839+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:45:28.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.843+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:28.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.855+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:45:28.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.871+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:28.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.883+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:45:28.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.907+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:45:28.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.911+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:45:28.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.923+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:28.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.951+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:45:28.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.971+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:45:28.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.975+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:28.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.979+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:45:28.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:28.987+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:45:29.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.011+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:45:29.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.015+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:45:29.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.023+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:45:29.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.035+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:45:29.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.051+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:29.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.059+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:45:29.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.067+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:29.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.075+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:45:29.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.103+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:45:29.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.111+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:45:29.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.127+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:45:29.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.131+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:29.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.131+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:45:29.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.135+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:29.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.163+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:29.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.171+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:45:29.174 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 223 16 2865328 2865312 802.983 805.625 0.000830424 0.00123351 2024-09-16T03:45:29.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.175+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:29.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.191+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:45:29.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.191+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:45:29.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.215+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:45:29.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.219+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:45:29.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.235+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:45:29.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.243+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:45:29.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.255+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:29.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.255+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:45:29.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.275+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:45:29.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.307+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:29.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.311+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:29.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.331+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:29.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.331+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:45:29.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.371+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:45:29.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.375+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:45:29.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.387+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:29.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.387+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:45:29.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.391+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:45:29.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.399+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:45:29.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.399+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:45:29.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:29.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.423+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:45:29.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.443+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:45:29.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.443+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:45:29.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.451+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:29.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.455+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:45:29.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.463+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:45:29.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.483+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:45:29.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.491+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:29.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.495+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:45:29.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.515+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:45:29.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.515+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:29.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.519+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:45:29.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.531+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:45:29.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.543+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:45:29.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.559+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:45:29.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.575+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:45:29.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.583+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:45:29.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.591+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:45:29.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.591+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:45:29.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.603+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:45:29.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.623+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:45:29.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.631+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:29.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.631+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:29.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.647+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:29.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.647+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:29.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.675+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:45:29.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.679+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:45:29.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.683+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:45:29.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.691+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:29.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.715+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:45:29.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.735+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:45:29.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.739+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:45:29.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.739+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:45:29.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.755+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:45:29.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.767+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:45:29.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.779+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:45:29.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.791+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:45:29.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.799+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:29.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.799+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:29.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.823+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:45:29.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.823+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:29.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.831+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:45:29.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.831+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:45:29.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.879+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:45:29.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.883+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:45:29.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:29.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.907+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:29.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.911+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:45:29.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.923+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:29.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.931+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:45:29.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.935+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:29.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.943+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:29.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.983+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:45:29.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.987+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:29.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:29.995+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:30.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.003+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:45:30.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.035+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:45:30.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.035+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:30.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.059+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:30.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.075+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:30.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.079+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:45:30.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.083+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:30.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.107+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:45:30.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.111+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:30.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.115+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:45:30.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.131+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:45:30.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.135+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:45:30.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.159+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:45:30.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.167+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:45:30.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.171+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:45:30.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 224 16 2878083 2878067 802.956 797.188 0.000678114 0.00123355 2024-09-16T03:45:30.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.179+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:45:30.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.191+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:30.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.207+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:45:30.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.219+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:45:30.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.223+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:45:30.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.231+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:45:30.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.231+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:30.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.271+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:30.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.283+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:45:30.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.311+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:30.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.315+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:45:30.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.319+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:45:30.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.327+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:30.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.347+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:45:30.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.359+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:45:30.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.367+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:45:30.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.371+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:30.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.375+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:30.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.395+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:45:30.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.399+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:45:30.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.411+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:45:30.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.419+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:45:30.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.439+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:30.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.439+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:45:30.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.459+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:45:30.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.471+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:45:30.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.483+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:45:30.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.483+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:45:30.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.483+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:30.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.503+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:45:30.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.519+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:30.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.523+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:45:30.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.523+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:30.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.579+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:45:30.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.607+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:45:30.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.623+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:45:30.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.631+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:30.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.651+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:30.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.651+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:30.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.655+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:30.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.675+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:45:30.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.711+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:45:30.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.715+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:30.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.727+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:45:30.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.731+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:30.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.735+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:30.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.739+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:45:30.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.755+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:30.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.759+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:45:30.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.763+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:30.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.771+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:45:30.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.771+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:45:30.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.787+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:30.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.799+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:30.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.799+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:45:30.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.839+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:30.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.843+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:45:30.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.867+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:45:30.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.871+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:30.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.883+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:45:30.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.887+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:30.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.895+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:30.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.919+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:45:30.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.927+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:45:30.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.939+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:45:30.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.943+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:45:30.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.955+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:30.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.967+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:30.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:30.983+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:31.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.003+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:45:31.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.039+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:45:31.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.043+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:31.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.051+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:45:31.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.067+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:31.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.075+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:31.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.099+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:31.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.103+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:45:31.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.143+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:45:31.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.159+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:31.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.163+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:45:31.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.167+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:45:31.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 225 16 2891131 2891115 803.012 815.5 0.000494561 0.00123346 2024-09-16T03:45:31.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.175+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:45:31.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.219+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:45:31.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.223+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:45:31.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.223+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:31.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.243+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:45:31.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.267+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:45:31.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.291+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:45:31.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.303+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:45:31.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.339+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:45:31.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.339+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:31.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.343+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:45:31.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.367+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:45:31.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.374+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:31.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.382+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:31.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.382+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:31.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.402+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:45:31.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.410+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:45:31.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.446+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:31.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.462+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:45:31.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.466+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:45:31.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.478+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:31.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.482+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:45:31.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.486+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:31.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.494+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:31.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.546+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:45:31.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.550+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:45:31.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:45:31.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.586+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:31.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.606+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:31.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.618+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:31.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.622+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:45:31.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.642+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:31.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.662+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:45:31.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:31.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.678+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:45:31.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.702+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:45:31.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:45:31.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.730+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:45:31.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.750+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:45:31.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.766+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:31.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.770+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:45:31.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.778+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:45:31.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:45:31.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.786+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:45:31.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:31.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.814+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:45:31.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.822+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:31.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.834+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:45:31.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.846+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:45:31.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.858+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:45:31.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.858+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:31.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.878+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:45:31.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.886+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:45:31.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.890+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:31.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:45:31.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.954+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:45:31.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.966+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:45:31.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.970+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:45:31.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.978+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:45:32.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.998+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:45:32.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:31.998+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:45:32.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.014+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:45:32.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.014+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:32.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.022+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:32.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.030+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:45:32.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:45:32.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.058+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:32.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.066+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:45:32.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.066+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:45:32.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.086+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:45:32.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.102+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:32.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.126+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:32.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.126+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:32.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.130+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:45:32.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.150+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:32.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.166+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:32.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 226 16 2904378 2904362 803.122 827.938 0.000850623 0.0012333 2024-09-16T03:45:32.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.174+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:45:32.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.190+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:45:32.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.198+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:45:32.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.202+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:45:32.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.222+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:32.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.226+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:32.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:45:32.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.234+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:45:32.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.246+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:45:32.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.262+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:45:32.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.306+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:32.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.306+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:32.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.322+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:32.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:32.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.342+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:45:32.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.366+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:32.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.370+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:45:32.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.370+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:45:32.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.386+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:45:32.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.410+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:45:32.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.418+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:45:32.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.430+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:32.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.434+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:45:32.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.434+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:45:32.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.446+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:32.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.450+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:45:32.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:45:32.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.462+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:45:32.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.470+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:45:32.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.470+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:45:32.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.490+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:32.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:45:32.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:45:32.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.534+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:45:32.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.538+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:32.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.554+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:45:32.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.566+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:32.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.582+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:45:32.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.586+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:32.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.602+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:45:32.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.610+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:45:32.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.622+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:45:32.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.626+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:45:32.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.646+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:45:32.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.650+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:32.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.698+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:32.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.702+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:32.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:32.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.718+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:32.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.734+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:45:32.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.734+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:32.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.738+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:45:32.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.770+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:32.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.774+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:45:32.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.790+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:32.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.790+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:32.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.814+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:32.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.818+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:45:32.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:45:32.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.826+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:45:32.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:45:32.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.894+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:45:32.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:45:32.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.906+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:32.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.910+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:45:32.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.910+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:45:32.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.934+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:45:32.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:45:32.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.982+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:45:32.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:32.986+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:45:33.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.002+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:33.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.002+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:45:33.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.022+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:45:33.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.026+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:45:33.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.026+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:33.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.042+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:45:33.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.050+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:45:33.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.082+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:45:33.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.086+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:33.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.110+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:45:33.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.114+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:33.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.134+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:45:33.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.154+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:33.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.162+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:33.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 227 16 2917647 2917631 803.237 829.312 0.00101851 0.00123312 2024-09-16T03:45:33.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.174+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:45:33.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.182+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:33.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.182+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:45:33.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.186+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:45:33.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.202+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:33.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.210+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:45:33.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:45:33.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.226+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:45:33.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.246+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:33.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.258+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:45:33.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.270+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:45:33.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.286+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:33.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.290+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:45:33.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.294+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:45:33.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.310+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:45:33.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.326+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:45:33.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.342+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:45:33.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.346+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:33.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:45:33.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:33.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.378+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:45:33.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.382+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:45:33.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.394+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:45:33.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:33.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.430+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:45:33.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.438+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:33.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.454+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:45:33.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.458+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:33.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.462+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:33.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.482+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:45:33.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.490+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:33.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.506+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:45:33.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.514+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:45:33.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.522+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:45:33.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.530+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:45:33.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.542+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:45:33.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.554+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:33.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.558+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:45:33.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:45:33.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.578+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:33.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.594+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:45:33.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.606+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:33.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:33.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.622+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:45:33.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:45:33.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.654+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:45:33.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.666+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:33.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:45:33.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.694+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:45:33.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.730+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:33.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.730+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:45:33.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.746+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:45:33.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.746+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:45:33.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.754+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:45:33.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.778+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:45:33.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.794+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:45:33.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.810+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:45:33.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.822+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:45:33.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.822+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:33.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:45:33.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.862+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:45:33.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.866+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:33.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.870+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:45:33.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.878+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:33.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.894+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:45:33.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.898+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:33.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.934+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:45:33.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.934+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:45:33.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.950+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:45:33.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.970+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:45:33.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.978+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:45:33.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.986+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:45:33.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:33.994+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:34.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.030+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:34.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.034+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:34.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.046+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:45:34.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.058+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:34.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.062+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:45:34.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.078+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:34.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.174+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:45:34.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.186+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:45:34.190 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 228 16 2930090 2930074 803.124 777.688 0.00106446 0.00123329 2024-09-16T03:45:34.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.194+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:45:34.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.206+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:45:34.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.266+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:45:34.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:34.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:45:34.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.286+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:45:34.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.298+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:34.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.318+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:45:34.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.326+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:45:34.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.330+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:45:34.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.358+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:45:34.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.362+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:45:34.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.362+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:45:34.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.394+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:45:34.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.398+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:45:34.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.430+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:34.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.438+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:45:34.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.490+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:34.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.494+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:45:34.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.498+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:34.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.514+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:45:34.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:34.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:45:34.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.558+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:45:34.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.558+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:34.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.562+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:45:34.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:45:34.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.606+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:45:34.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.634+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:45:34.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.638+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:45:34.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.650+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:45:34.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.650+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:34.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.666+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:34.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.706+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:34.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.726+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:34.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.738+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:45:34.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.742+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:45:34.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.746+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:34.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:45:34.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.770+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:34.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.770+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:45:34.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.794+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:45:34.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:45:34.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.810+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:45:34.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.834+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:45:34.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.846+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:45:34.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.862+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:45:34.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.866+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:45:34.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:45:34.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.890+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:34.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.894+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:45:34.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.894+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:45:34.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.926+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:45:34.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.930+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:34.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.942+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:45:34.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.958+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:34.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:45:34.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.978+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:45:34.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:34.986+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:45:35.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.002+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:45:35.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.014+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:35.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.026+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:45:35.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.046+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:45:35.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:35.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.070+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:45:35.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:45:35.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.082+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:45:35.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.086+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:45:35.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.094+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:45:35.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:35.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:45:35.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:35.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.170+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:35.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 229 15 2942824 2942809 803.093 795.938 0.000987649 0.00123334 2024-09-16T03:45:35.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.174+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:35.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.178+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:35.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.210+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:45:35.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.238+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:45:35.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.238+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:35.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.242+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:45:35.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.270+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:45:35.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.294+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:45:35.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.302+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:45:35.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.310+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:35.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.342+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:45:35.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.346+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:45:35.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.354+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:35.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.390+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:45:35.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.398+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:35.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.406+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:45:35.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.426+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:35.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.434+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:45:35.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.442+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:45:35.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.442+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:45:35.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.442+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:45:35.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.462+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:35.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.482+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:35.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:45:35.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.502+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:45:35.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:45:35.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.530+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:45:35.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.550+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:45:35.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.550+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:45:35.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.570+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:45:35.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.582+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:45:35.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.590+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:45:35.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.618+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:35.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.630+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:45:35.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.630+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:35.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.638+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:45:35.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.642+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:45:35.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.690+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:45:35.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:45:35.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.714+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:45:35.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.718+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:45:35.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.722+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:45:35.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.742+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:45:35.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.746+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:45:35.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.762+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:35.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:45:35.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.766+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:35.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.794+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:45:35.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.802+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:45:35.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:45:35.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:45:35.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.834+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:45:35.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:45:35.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.854+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:45:35.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:35.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.886+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:35.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.886+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:35.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.894+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:45:35.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.898+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:45:35.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.898+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:45:35.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.918+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:45:35.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.946+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:45:35.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:45:35.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.958+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:45:35.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:45:35.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:35.982+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:45:36.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.002+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:36.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.034+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:45:36.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.034+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:45:36.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.038+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:45:36.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.050+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:45:36.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:45:36.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.066+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:45:36.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:45:36.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.106+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:45:36.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.118+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:45:36.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.126+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:45:36.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.126+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:36.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:45:36.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.162+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:45:36.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.166+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:45:36.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 230 15 2956091 2956076 803.206 829.188 0.000728312 0.00123316 2024-09-16T03:45:36.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.178+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:45:36.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.182+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:45:36.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.198+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:45:36.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.210+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:45:36.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.214+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:45:36.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.226+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:45:36.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.226+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:45:36.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.238+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:45:36.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.250+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:36.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.274+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:45:36.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.294+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:45:36.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:45:36.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.322+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:45:36.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.338+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:45:36.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.338+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:45:36.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.354+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:45:36.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.354+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:45:36.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.366+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:45:36.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.374+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:45:36.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.406+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:45:36.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:45:36.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:45:36.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.418+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:45:36.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.434+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:36.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.446+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:45:36.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.474+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:36.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.482+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:45:36.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.482+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:45:36.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.486+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:45:36.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.494+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:45:36.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.514+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:45:36.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.514+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:45:36.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.530+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:45:36.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.546+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:45:36.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.554+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:45:36.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.570+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:45:36.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.586+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:45:36.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.590+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:36.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.590+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:45:36.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.598+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:45:36.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.614+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:45:36.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.622+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:45:36.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.626+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:45:36.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.634+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:45:36.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.654+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:45:36.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.662+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:45:36.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.670+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:45:36.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.694+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:45:36.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.714+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:45:36.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.746+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:45:36.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.746+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:45:36.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.750+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:45:36.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.750+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:36.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.774+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:45:36.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.790+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:45:36.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.810+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:45:36.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.810+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:45:36.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.830+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:45:36.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.838+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:45:36.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.850+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:45:36.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:45:36.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:45:36.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.882+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:45:36.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.886+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:45:36.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.902+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:45:36.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.906+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:36.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:36.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.938+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:45:36.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.946+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:45:36.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.950+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:45:36.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.974+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:36.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:36.994+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:45:37.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.002+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:45:37.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.018+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:45:37.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:45:37.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.066+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:45:37.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:45:37.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.094+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:45:37.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.094+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:45:37.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.106+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:37.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.134+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:45:37.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.142+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:45:37.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.146+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:37.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.166+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:37.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 231 16 2969057 2969041 803.236 810.312 0.000645516 0.0012331 2024-09-16T03:45:37.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:45:37.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.190+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:45:37.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.210+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:37.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.234+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:45:37.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.238+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:45:37.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.242+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:45:37.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.242+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:37.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.254+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:45:37.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.266+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:37.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.278+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:45:37.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.302+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:37.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:45:37.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.318+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:45:37.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.322+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:45:37.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.338+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:45:37.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.346+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:45:37.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.358+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:45:37.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.366+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:45:37.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.386+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:45:37.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.390+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:37.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.402+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:45:37.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.430+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:45:37.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.438+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:45:37.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.450+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:45:37.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.454+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:37.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.474+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:45:37.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.474+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:37.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.486+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:45:37.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.494+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:45:37.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.502+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:37.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.506+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:37.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.522+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:45:37.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.538+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:37.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.554+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:45:37.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:45:37.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.578+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:45:37.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.594+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:37.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.598+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:45:37.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.606+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:45:37.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.610+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:45:37.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.618+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:37.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.642+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:37.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.662+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:45:37.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.670+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:37.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.674+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:45:37.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.678+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:37.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.682+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:45:37.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.686+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:45:37.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:45:37.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.714+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:45:37.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.730+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:45:37.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.742+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:45:37.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.766+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:45:37.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.778+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:45:37.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.790+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:45:37.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.794+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:45:37.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.802+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:45:37.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.806+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:37.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.826+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:45:37.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.846+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:45:37.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:45:37.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:45:37.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.882+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:45:37.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.890+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:45:37.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:45:37.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.898+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:45:37.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.902+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:45:37.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.922+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:45:37.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.930+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:37.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:37.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.950+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:45:37.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:37.982+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:45:38.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:38.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.010+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:45:38.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.026+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:45:38.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.030+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:45:38.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.038+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:38.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.070+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:45:38.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:45:38.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.102+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:45:38.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:45:38.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.130+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:38.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.146+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:45:38.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.154+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:45:38.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.154+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:45:38.175 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 232 16 2981946 2981930 803.246 805.562 0.000754719 0.00123309 2024-09-16T03:45:38.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.170+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:45:38.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:45:38.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.190+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:45:38.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.194+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:45:38.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.214+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:45:38.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.214+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:38.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.218+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:45:38.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.222+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:45:38.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.230+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:45:38.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.258+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:45:38.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.274+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:38.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.302+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:45:38.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:45:38.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.314+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:45:38.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.322+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:45:38.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.322+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:45:38.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.346+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:45:38.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:45:38.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.366+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:45:38.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.374+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:45:38.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.382+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:45:38.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.398+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:38.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:38.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.426+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:45:38.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.446+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:45:38.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.450+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:38.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.466+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:45:38.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.466+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:45:38.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.478+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:45:38.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.506+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:45:38.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:45:38.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.514+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:45:38.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:38.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.542+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:45:38.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.550+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:38.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.554+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:38.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.558+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:38.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.594+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:38.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.614+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:45:38.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.618+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:45:38.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:45:38.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.630+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:45:38.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.642+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:38.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.650+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:45:38.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.658+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:45:38.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:45:38.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.682+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:38.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.686+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:45:38.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.698+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:45:38.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.714+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:38.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.722+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:38.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.746+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:45:38.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.746+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:45:38.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.754+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:38.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.778+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:38.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.778+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:45:38.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.782+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:45:38.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.794+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:45:38.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.806+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:38.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:45:38.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.846+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:38.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.846+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:45:38.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.862+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:38.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.870+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:45:38.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.882+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:38.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.890+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:38.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.890+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:45:38.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.898+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:38.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:45:38.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.914+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:38.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.946+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:38.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.958+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:45:39.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:38.998+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:39.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.010+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:45:39.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.026+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:39.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.038+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:39.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.042+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:45:39.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.066+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:39.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:45:39.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.086+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:39.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.086+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:45:39.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:45:39.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.106+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:39.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.114+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:45:39.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.122+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:39.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.134+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:39.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 233 16 2994408 2994392 803.141 778.875 0.000406978 0.00123311 2024-09-16T03:45:39.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.266+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:45:39.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.274+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:45:39.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:39.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.294+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:45:39.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.306+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:45:39.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:39.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.354+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:45:39.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.354+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:45:39.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.378+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:39.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:45:39.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.426+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:45:39.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:45:39.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.450+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:45:39.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:45:39.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.470+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:45:39.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.478+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:45:39.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.506+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:39.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.514+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:45:39.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.514+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:45:39.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.518+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:39.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.538+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:39.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:45:39.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.574+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:45:39.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.578+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:45:39.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.582+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:39.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.594+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:39.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.606+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:45:39.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.614+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:45:39.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.614+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:45:39.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.634+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:45:39.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.634+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:45:39.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.670+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:39.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.690+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:39.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.698+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:45:39.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.722+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:45:39.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.730+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:45:39.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.750+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:45:39.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.750+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:45:39.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.758+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:45:39.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:39.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.782+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:45:39.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.806+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:39.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.822+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:45:39.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:39.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.838+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:45:39.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:45:39.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.850+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:45:39.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.870+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:45:39.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:45:39.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.890+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:45:39.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:45:39.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.930+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:39.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.930+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:45:39.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.950+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:45:39.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.954+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:45:39.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.962+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:45:39.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.978+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:45:39.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:39.978+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:45:40.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.002+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:45:40.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.010+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:45:40.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.018+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:45:40.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.022+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:45:40.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.022+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:40.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.026+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:45:40.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.046+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:40.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.054+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:45:40.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.082+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:40.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:45:40.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.086+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:40.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.098+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:45:40.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.102+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:45:40.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.118+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:45:40.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:45:40.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.134+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:45:40.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.150+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:45:40.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.158+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:45:40.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.170+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:40.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 234 15 3005563 3005548 802.688 697.25 0.000903888 0.00123395 2024-09-16T03:45:40.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.182+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:45:40.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.186+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:40.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.226+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:45:40.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:40.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.234+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:45:40.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.266+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:40.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.270+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:45:40.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.290+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:40.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.298+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:40.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.306+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:45:40.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.310+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:40.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.318+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:45:40.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.334+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:45:40.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.350+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:45:40.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.362+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:45:40.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.370+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:40.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.370+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:45:40.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.394+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:45:40.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.394+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:40.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.414+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:40.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.426+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:40.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.426+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:45:40.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:45:40.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.478+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:45:40.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.478+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:40.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.498+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:45:40.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:40.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.510+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:45:40.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.534+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:45:40.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.534+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:45:40.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.550+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:40.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.566+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:45:40.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.574+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:45:40.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.582+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:45:40.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.586+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:45:40.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.606+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:45:40.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.610+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:45:40.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.626+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:45:40.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.626+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:45:40.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.654+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:45:40.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.658+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:45:40.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.666+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:40.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.670+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:40.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.694+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:40.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.702+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:40.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.714+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:45:40.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.718+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:45:40.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.726+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:45:40.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.726+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:45:40.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.742+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:45:40.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.742+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:45:40.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.754+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:40.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:45:40.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:45:40.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.778+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:45:40.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:45:40.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.822+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:40.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:45:40.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.838+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:45:40.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.846+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:40.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.850+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:45:40.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.862+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:45:40.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.874+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:45:40.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:40.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.914+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:40.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.922+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:45:40.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.926+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:45:40.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.934+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:40.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.970+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:45:40.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.970+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:45:40.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:40.978+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:45:41.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.010+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:41.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.022+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:45:41.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.022+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:45:41.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.038+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:45:41.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.054+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:41.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.058+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:41.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.070+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:45:41.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:45:41.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.086+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:45:41.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.090+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:45:41.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.114+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:45:41.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:45:41.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:45:41.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.130+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:45:41.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.138+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:41.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.154+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:41.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 235 15 3018622 3018607 802.745 816.188 0.000690144 0.00123386 2024-09-16T03:45:41.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.170+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:45:41.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.182+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:41.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.194+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:45:41.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.206+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:45:41.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.210+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:45:41.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.210+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:45:41.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.234+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:45:41.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.250+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:45:41.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.254+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:41.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.266+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:45:41.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.278+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:41.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.282+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:45:41.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.286+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:41.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.314+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:45:41.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.334+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:41.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.346+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:41.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.362+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:45:41.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.366+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:41.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.370+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:45:41.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.386+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:45:41.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.406+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:41.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.406+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:45:41.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.410+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:45:41.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.430+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:45:41.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.450+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:45:41.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.458+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:41.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.478+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:45:41.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.478+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:45:41.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.482+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:41.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.486+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:45:41.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.502+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:45:41.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.514+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:45:41.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.534+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:45:41.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.546+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:41.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.590+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:45:41.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.598+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:45:41.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.606+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:41.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.626+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:41.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.650+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:41.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.662+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:45:41.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.666+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:45:41.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.682+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:45:41.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.690+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:41.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.702+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:45:41.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.706+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:41.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.722+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:41.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:45:41.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.738+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:45:41.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.738+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:45:41.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.754+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:45:41.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.754+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:45:41.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:45:41.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.786+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:45:41.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:45:41.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.798+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:45:41.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.850+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:45:41.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:45:41.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.862+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:45:41.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.878+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:45:41.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.882+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:45:41.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.898+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:45:41.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.906+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:45:41.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.906+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:41.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:41.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.922+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:41.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:41.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.954+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:45:41.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.974+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:45:41.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.978+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:42.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:41.994+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:45:42.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:45:42.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.006+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:45:42.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.014+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:45:42.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.094+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:45:42.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.098+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:42.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.106+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:45:42.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.110+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:42.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.110+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:42.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:45:42.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.146+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:45:42.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.158+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:42.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 236 16 3030462 3030446 802.479 739.938 0.000767118 0.00123429 2024-09-16T03:45:42.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.182+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:45:42.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:42.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.206+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:42.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.214+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:45:42.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.222+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:45:42.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.250+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:45:42.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.266+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:42.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.270+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:42.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.274+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:42.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.298+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:45:42.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.306+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:42.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.318+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:45:42.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.326+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:45:42.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.350+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:42.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.354+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:42.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.362+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:45:42.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:45:42.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.378+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:45:42.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.390+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:42.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.398+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:45:42.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.414+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:45:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.446+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:42.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.446+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:42.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.454+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:42.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.462+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:45:42.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.474+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:42.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.478+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:45:42.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.486+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:45:42.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.490+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:45:42.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.538+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:45:42.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:45:42.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.554+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:45:42.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.562+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:45:42.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.570+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:45:42.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:45:42.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.578+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:42.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.590+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:45:42.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.610+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:45:42.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.614+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:42.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.622+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:45:42.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.622+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:45:42.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.642+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:45:42.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.650+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:45:42.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.670+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:45:42.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.698+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:45:42.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.698+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:42.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.718+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:42.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.718+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:45:42.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.738+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:45:42.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.742+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:45:42.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.750+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:45:42.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.758+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:42.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.782+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:42.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.786+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:42.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.794+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:42.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.802+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:45:42.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.806+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:45:42.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:42.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.826+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:42.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.842+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:45:42.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.854+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:45:42.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.866+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:45:42.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:45:42.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.886+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:45:42.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.898+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:42.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.910+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:42.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:45:42.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.910+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:42.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.950+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:42.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.954+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:45:42.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:45:42.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.966+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:45:42.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.974+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:45:42.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.994+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:45:43.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:42.998+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:43.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.022+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:45:43.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.042+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:45:43.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.046+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:43.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.050+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:45:43.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.074+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:45:43.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.078+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:45:43.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.094+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:45:43.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.106+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:45:43.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.122+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:43.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.126+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:45:43.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.134+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:45:43.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:45:43.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.150+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:45:43.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.154+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:45:43.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.158+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:45:43.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:43.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 237 15 3043428 3043413 802.512 810.438 0.000829312 0.00123422 2024-09-16T03:45:43.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.186+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:43.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.210+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:45:43.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.226+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:45:43.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.230+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:43.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.246+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:45:43.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.278+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:43.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.290+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:45:43.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.306+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:43.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.318+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:45:43.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.322+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:43.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.330+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:45:43.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.338+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:45:43.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.342+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:45:43.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:45:43.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.366+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:45:43.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.386+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:45:43.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.398+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:45:43.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:45:43.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.418+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:45:43.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.430+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:45:43.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.434+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:45:43.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.438+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:45:43.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.466+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:45:43.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.490+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:45:43.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.498+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:45:43.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.510+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:45:43.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.526+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:45:43.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.530+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:45:43.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.538+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:45:43.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.562+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:45:43.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.566+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:45:43.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.574+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:45:43.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.582+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:45:43.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.590+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:45:43.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.602+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:45:43.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.606+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:45:43.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.638+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:45:43.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.654+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:45:43.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.654+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:43.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.662+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:45:43.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.682+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:45:43.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.682+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:45:43.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.682+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:45:43.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.690+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:43.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.718+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:45:43.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.718+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:45:43.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.734+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:45:43.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.734+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:43.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.746+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:45:43.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.754+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:45:43.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.786+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:43.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.786+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:43.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.806+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:45:43.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.814+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:43.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.826+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:45:43.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:45:43.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.838+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:45:43.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.842+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:43.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.854+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:45:43.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.862+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:45:43.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.890+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:43.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.918+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:45:43.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.934+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:45:43.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.938+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:45:43.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.970+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:43.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.982+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:45:44.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:43.994+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:45:44.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.014+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:45:44.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.026+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:45:44.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.038+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:44.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.042+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:45:44.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.054+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:45:44.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.070+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:45:44.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.074+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:45:44.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.090+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:45:44.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.098+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:45:44.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.114+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:45:44.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:44.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.134+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:44.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.142+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:45:44.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.150+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:45:44.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.166+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:45:44.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 238 16 3056473 3056457 802.565 815.25 0.000601415 0.00123415 2024-09-16T03:45:44.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.182+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:45:44.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.186+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:44.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.198+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:45:44.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:45:44.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.222+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:45:44.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.222+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:44.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.234+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:45:44.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.238+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:45:44.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.254+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:44.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.258+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:45:44.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.270+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:44.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.274+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:45:44.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.282+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:44.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.282+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:44.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.302+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:45:44.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.302+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:45:44.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.310+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:44.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.334+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:44.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.342+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:45:44.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.350+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:45:44.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.350+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:45:44.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.382+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:45:44.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.390+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:45:44.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.402+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:44.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.414+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:45:44.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:45:44.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.438+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:45:44.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.442+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:44.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.462+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:45:44.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.482+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:44.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:44.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:45:44.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.514+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:45:44.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.518+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:45:44.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.530+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:45:44.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:44.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:45:44.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.546+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:45:44.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.554+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:45:44.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:44.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.586+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:44.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.598+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:45:44.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.602+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:44.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.610+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:45:44.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.618+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:45:44.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.626+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:44.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.638+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:45:44.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.646+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:44.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.666+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:45:44.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.670+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:45:44.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:45:44.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.698+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:45:44.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.702+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:44.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.702+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:44.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.714+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:44.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.722+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:45:44.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.734+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:45:44.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.750+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:45:44.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.754+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:45:44.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.758+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:44.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.778+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:44.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.790+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:44.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.798+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:45:44.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:44.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.822+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:44.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.866+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:45:44.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.878+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:45:44.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.890+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:45:44.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.902+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:45:44.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.906+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:45:44.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.910+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:45:44.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.926+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:45:44.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.930+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:45:44.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.938+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:44.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.954+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:45:44.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.954+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:45:44.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:45:44.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.990+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:45:45.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.998+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:45.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:44.998+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:45.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.006+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:45:45.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.030+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:45:45.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.046+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:45:45.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.046+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:45:45.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.058+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:45:45.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.070+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:45:45.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.070+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:45:45.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.070+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:45:45.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:45:45.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.118+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:45:45.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.118+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:45.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.126+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:45:45.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.146+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:45.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.158+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:45:45.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.158+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:45.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.166+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:45.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 239 16 3069181 3069165 802.53 794.25 0.000574768 0.0012342 2024-09-16T03:45:45.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.174+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:45:45.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.198+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:45:45.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.202+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:45:45.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.210+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:45.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.230+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:45.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.230+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:45:45.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.242+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:45:45.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.246+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:45:45.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.254+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:45.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.274+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:45:45.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.286+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:45:45.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.322+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:45:45.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:45:45.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.326+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:45:45.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.338+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:45:45.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.354+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:45.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.354+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:45.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.370+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:45:45.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.378+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:45.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.390+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:45:45.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.394+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:45:45.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.402+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:45.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.418+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:45:45.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.422+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:45:45.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.430+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:45:45.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.442+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:45:45.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.442+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:45.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.458+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:45:45.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.478+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:45:45.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.486+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:45:45.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.494+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:45:45.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.498+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:45:45.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.510+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:45:45.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.522+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:45:45.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.522+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:45:45.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.522+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:45:45.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.558+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:45:45.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.558+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:45:45.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:45:45.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.578+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:45:45.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.594+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:45:45.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.598+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:45:45.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.602+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:45:45.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.614+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:45:45.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.634+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:45:45.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.654+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:45:45.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.666+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:45.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.670+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:45:45.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.678+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:45:45.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.698+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:45:45.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.710+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:45:45.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.714+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:45:45.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.734+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:45:45.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.750+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:45:45.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.758+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:45:45.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.762+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:45.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.770+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:45:45.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.802+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:45.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.822+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:45:45.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.834+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:45:45.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.838+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:45.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.838+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:45:45.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.846+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:45:45.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:45:45.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.878+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:45.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:45:45.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.886+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:45:45.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.898+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:45:45.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.898+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:45:45.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.922+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:45:45.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.930+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:45:45.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.982+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:45:45.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.986+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:46.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:45.998+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:45:46.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.018+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:46.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.022+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:46.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.030+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:46.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.034+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:45:46.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.046+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:46.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.050+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:46.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.074+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:45:46.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.082+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:45:46.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.090+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:45:46.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.122+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:45:46.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.126+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:45:46.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.134+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:45:46.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.142+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:45:46.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.158+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:45:46.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:45:46.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.170+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:45:46.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:45:46.177102+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123427 2024-09-16T03:45:46.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:45:46.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 240 16 3081899 3081883 802.498 794.875 0.000874321 0.00123427 2024-09-16T03:45:46.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.174+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:45:46.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.178+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:45:46.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.186+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:46.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.198+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:46.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.218+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:45:46.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.234+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:46.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.242+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:45:46.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.254+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:45:46.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.258+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:45:46.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.270+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:45:46.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.278+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:46.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.294+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:45:46.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.298+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:45:46.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.310+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:45:46.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.318+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:46.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.330+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:45:46.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:45:46.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.354+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:45:46.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.362+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:45:46.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.370+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:45:46.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.374+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:45:46.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.386+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:45:46.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:46.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.418+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:45:46.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.446+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:46.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.446+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:45:46.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.454+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:45:46.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.454+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:46.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.462+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:45:46.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.494+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:46.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:45:46.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.518+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:45:46.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.534+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:45:46.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.542+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:45:46.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:45:46.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.550+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:45:46.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.570+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:45:46.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:45:46.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.582+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:45:46.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.598+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:46.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.606+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:45:46.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.626+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:45:46.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.646+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:45:46.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.650+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:46.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.654+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:45:46.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.674+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:45:46.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.706+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:45:46.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.718+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:46.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.742+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:45:46.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.746+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:45:46.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.774+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:45:46.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.778+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:45:46.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.778+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:45:46.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.782+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:45:46.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:45:46.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.822+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:45:46.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.846+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:45:46.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.850+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:46.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.854+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:45:46.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.858+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:45:46.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.866+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:45:46.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:45:46.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.898+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:46.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:45:46.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.914+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:45:46.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.918+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:45:46.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.938+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:45:46.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.938+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:46.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:46.978+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:45:47.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.014+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:45:47.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.022+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:45:47.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.026+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:45:47.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.026+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:45:47.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:47.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.050+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:45:47.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.054+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:45:47.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.074+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:45:47.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.078+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:45:47.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.086+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:45:47.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.110+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:45:47.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.130+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:47.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.142+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:45:47.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.150+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:45:47.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.162+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:45:47.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.170+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:47.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 241 15 3094966 3094951 802.557 816.75 0.00121246 0.00123417 2024-09-16T03:45:47.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.186+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:45:47.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:45:47.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.214+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:45:47.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.214+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:45:47.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.242+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:47.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.250+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:45:47.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.258+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:47.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.270+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:45:47.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:45:47.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.282+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:45:47.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.290+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:45:47.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.310+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:45:47.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.318+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:45:47.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.346+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:45:47.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:45:47.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.374+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:45:47.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:45:47.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.406+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:45:47.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.430+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:45:47.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.442+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:45:47.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.454+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:45:47.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.462+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:45:47.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.494+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:45:47.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.494+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:45:47.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.506+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:45:47.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.506+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:45:47.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.514+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:47.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.534+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:47.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.534+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:45:47.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.534+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:45:47.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:47.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.558+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:45:47.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.570+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:45:47.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.582+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:45:47.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.602+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:45:47.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.610+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:47.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.622+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:47.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:45:47.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.642+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:47.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.666+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:45:47.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.670+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:47.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.670+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:47.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.682+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:47.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.682+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:47.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.742+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:45:47.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.746+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:45:47.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.746+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:45:47.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.758+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:47.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.766+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:47.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:45:47.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.810+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:45:47.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:47.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:47.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.826+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:45:47.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.850+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:45:47.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.874+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:47.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.878+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:47.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.902+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:45:47.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:47.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.926+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:47.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.934+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:45:47.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.950+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:45:47.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.954+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:47.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.974+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:47.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.978+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:47.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.994+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:45:48.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.998+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:45:48.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:47.998+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:48.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.006+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:45:48.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.022+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:45:48.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.022+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:45:48.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.022+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:45:48.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:45:48.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.058+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:48.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.082+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:45:48.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.082+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:45:48.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.090+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:45:48.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.102+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:45:48.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.106+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:48.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.138+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:45:48.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.138+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:45:48.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.158+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:48.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.170+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:45:48.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 242 16 3108163 3108147 802.648 824.75 0.00143757 0.00123403 2024-09-16T03:45:48.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.178+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:45:48.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.190+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:45:48.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.194+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:45:48.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.206+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:48.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.210+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:45:48.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.230+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:45:48.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.238+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:45:48.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.242+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:45:48.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.270+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:45:48.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.274+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:45:48.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.278+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:45:48.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.278+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:48.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.298+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:48.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.302+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:45:48.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.326+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:48.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.326+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:45:48.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.338+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:45:48.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.354+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:48.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.370+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:45:48.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.382+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:45:48.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.390+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:45:48.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.394+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:45:48.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:45:48.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.430+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:48.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.438+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:45:48.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:45:48.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.446+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:45:48.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.462+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:48.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.490+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:48.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.510+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:45:48.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.522+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:45:48.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.526+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:48.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.550+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:45:48.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.558+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:45:48.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.574+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:45:48.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:45:48.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.578+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:45:48.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.586+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:45:48.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.602+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:45:48.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.606+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:45:48.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.606+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:48.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:45:48.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.638+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:45:48.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.642+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:45:48.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.642+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:45:48.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.662+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:45:48.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.670+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:48.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:45:48.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.690+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:45:48.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.706+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:45:48.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.726+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:48.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.726+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:45:48.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.738+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:45:48.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.746+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:45:48.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.750+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:45:48.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.754+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:45:48.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.758+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:45:48.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.810+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:45:48.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:45:48.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.814+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:45:48.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.830+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:45:48.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.858+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:45:48.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.886+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:45:48.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:48.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.906+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:45:48.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.906+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:48.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.914+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:48.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.918+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:45:48.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.922+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:48.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.946+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:45:48.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.962+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:48.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.974+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:48.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.974+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:48.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.986+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:45:48.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:48.986+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:45:49.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.002+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:49.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.018+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:45:49.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.026+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:45:49.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.038+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:49.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.038+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:49.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.050+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:45:49.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.066+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:45:49.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.070+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:45:49.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.090+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:45:49.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.094+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:45:49.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.110+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:45:49.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.118+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:45:49.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.126+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:45:49.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.130+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:49.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.146+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:45:49.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.166+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:45:49.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 243 16 3121229 3121213 802.705 816.625 0.00119585 0.00123394 2024-09-16T03:45:49.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.182+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:45:49.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:45:49.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.210+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:49.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:45:49.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.234+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:45:49.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.238+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:45:49.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.242+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:45:49.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.270+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:49.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.274+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:45:49.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.278+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:45:49.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.290+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:45:49.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.290+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:45:49.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.310+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:45:49.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.322+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:49.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.334+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:45:49.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:45:49.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.342+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:45:49.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.358+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:45:49.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.370+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:45:49.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.394+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:49.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.406+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:45:49.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.406+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:45:49.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.410+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:45:49.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.434+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:45:49.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.438+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:45:49.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.442+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:45:49.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.450+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:49.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.458+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:45:49.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.462+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:45:49.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.474+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:45:49.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:45:49.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.506+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:45:49.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.506+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:45:49.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.514+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:45:49.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.530+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:45:49.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:49.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.566+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:45:49.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.574+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:45:49.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.582+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:45:49.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.594+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:45:49.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.602+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:45:49.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.630+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:45:49.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.634+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:45:49.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.666+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:45:49.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.666+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:45:49.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.670+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:49.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.674+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:45:49.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.686+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:45:49.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:45:49.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.710+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:45:49.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.722+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:45:49.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.726+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:45:49.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.734+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:45:49.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.738+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:45:49.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:49.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.782+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:49.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.810+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:45:49.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.818+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:45:49.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.822+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:49.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.838+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:45:49.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.850+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:45:49.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.858+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:45:49.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:45:49.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.866+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:45:49.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.898+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:45:49.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.898+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:45:49.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.914+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:45:49.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.926+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:45:49.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.954+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:45:49.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:49.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.970+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:49.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.970+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:45:49.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.978+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:45:49.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:49.994+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:45:50.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.002+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:50.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.026+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:45:50.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.038+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:50.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:50.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.086+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:45:50.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.094+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:45:50.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.102+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:45:50.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.114+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:45:50.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:50.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.162+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:45:50.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 244 15 3134548 3134533 802.827 832.5 0.00121804 0.00123375 2024-09-16T03:45:50.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:50.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.186+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:45:50.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.202+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:50.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.202+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:50.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.210+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:50.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.214+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:45:50.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.218+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:50.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.234+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:45:50.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.242+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:50.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.254+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:45:50.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.258+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:45:50.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.270+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:45:50.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.278+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:45:50.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.310+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:50.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.334+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:45:50.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.334+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:45:50.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.350+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:45:50.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.350+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:45:50.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.366+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:45:50.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.374+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:45:50.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.378+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:45:50.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.414+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:45:50.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.414+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:45:50.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.434+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:45:50.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.442+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:45:50.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.454+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:45:50.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.458+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:50.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.466+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:45:50.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.478+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:50.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.482+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:45:50.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.490+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:45:50.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.498+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:45:50.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.506+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:45:50.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.514+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:45:50.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.514+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:45:50.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.534+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:45:50.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.550+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:45:50.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.558+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:45:50.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.566+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:45:50.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.570+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:45:50.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.574+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:45:50.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.574+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:50.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.590+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:45:50.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.590+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:50.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.602+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:45:50.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.618+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:45:50.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.630+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:45:50.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.650+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:50.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.662+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:45:50.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.694+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:45:50.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.710+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:45:50.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.714+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:45:50.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.722+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:45:50.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.726+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:45:50.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.734+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:45:50.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.742+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:45:50.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.754+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:45:50.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.762+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:45:50.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.778+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:45:50.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec08b55:::benchmark_data_smithi138_27857_object729:head, will try copies on 0,4 2024-09-16T03:45:50.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.798+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:45:50.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.798+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:45:50.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.818+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:45:50.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.826+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:50.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.830+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:45:50.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.842+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:45:50.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.854+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:45:50.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.882+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:45:50.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.898+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:45:50.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.898+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:45:50.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.910+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:45:50.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.926+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:45:50.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.926+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:45:50.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:50.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.954+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:45:50.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:45:50.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.966+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:45:50.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.970+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:45:50.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.982+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:45:50.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:50.986+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:45:51.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.010+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:45:51.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.026+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:45:51.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.030+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:45:51.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.054+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:45:51.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.054+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:45:51.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.062+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:45:51.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:45:51.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.102+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:45:51.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.130+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:45:51.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.150+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:45:51.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.154+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:51.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.162+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:51.176 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 245 15 3147662 3147647 802.895 819.625 0.000618422 0.00123364 2024-09-16T03:45:51.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.186+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:45:51.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:45:51.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.194+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:45:51.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:45:51.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.226+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:51.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.230+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:45:51.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.234+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:51.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.242+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:51.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.254+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:51.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.286+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:45:51.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.294+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:45:51.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.306+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:45:51.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:45:51.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.318+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:51.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:45:51.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.354+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:45:51.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.374+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:45:51.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.378+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:45:51.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.390+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:45:51.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:45:51.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:51.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.426+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:45:51.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.430+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:45:51.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.450+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:45:51.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:45:51.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.514+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:45:51.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:45:51.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.522+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:45:51.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:45:51.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.546+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:45:51.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.558+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:51.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.574+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:45:51.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.594+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:45:51.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.606+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:45:51.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.618+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:45:51.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.622+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:45:51.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.622+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:45:51.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:45:51.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.654+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:45:51.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.702+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:51.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:45:51.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.734+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:45:51.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.738+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:45:51.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.746+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:51.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.754+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:45:51.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.754+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:45:51.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.758+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:45:51.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.770+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:45:51.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.774+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:45:51.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.778+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:51.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.798+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:51.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.806+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:45:51.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.806+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:51.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.830+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:51.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.834+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:45:51.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.854+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:45:51.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.862+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:51.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:45:51.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.878+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:45:51.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.902+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:51.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.910+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:45:51.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.922+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:51.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.926+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:45:51.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.934+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:45:51.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.938+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:45:51.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.954+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:51.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.974+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:45:51.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.986+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:45:51.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:51.990+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:45:52.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:45:52.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.018+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:45:52.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.022+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:45:52.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.026+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:45:52.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.042+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:45:52.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.062+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:45:52.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:45:52.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.082+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:45:52.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:45:52.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.110+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:45:52.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.110+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:45:52.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.114+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:45:52.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.134+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:52.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.142+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:52.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.150+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:45:52.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.174+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:45:52.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 246 16 3161140 3161124 803.055 842.312 0.000914406 0.0012334 2024-09-16T03:45:52.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.194+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:45:52.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.210+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:45:52.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.214+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:52.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.218+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:45:52.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.230+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:45:52.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.230+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:45:52.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.234+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:45:52.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.242+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:45:52.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.278+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:45:52.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.290+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:45:52.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.302+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:45:52.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.310+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:45:52.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.330+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:45:52.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.342+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:45:52.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:45:52.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.354+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:52.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.358+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:52.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.362+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:45:52.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:52.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.386+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:45:52.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.414+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:45:52.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.414+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:52.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:45:52.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.430+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:45:52.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.446+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:52.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.454+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:45:52.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.462+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:45:52.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.462+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:45:52.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.486+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:45:52.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.502+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:45:52.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.510+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:52.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.514+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:45:52.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.526+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:45:52.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.546+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:45:52.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.554+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:45:52.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.558+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:45:52.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.566+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:45:52.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.578+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:45:52.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.590+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:45:52.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.594+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:52.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.602+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:45:52.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.626+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:45:52.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.626+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:45:52.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.658+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:45:52.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.666+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:45:52.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.670+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:45:52.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.682+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:45:52.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.694+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:45:52.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.706+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:45:52.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:45:52.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.742+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:45:52.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.746+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:45:52.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.750+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:52.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.762+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:52.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.778+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:45:52.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.802+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:45:52.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.814+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:45:52.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.814+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:45:52.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.830+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:52.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.834+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:45:52.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.846+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:45:52.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.846+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:45:52.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:45:52.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.866+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:52.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.870+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:45:52.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.902+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:45:52.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.906+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:52.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.922+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:45:52.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.938+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:45:52.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.962+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:45:52.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.966+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:52.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.978+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:45:52.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.986+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:45:52.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.994+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:45:52.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.994+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:53.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:52.994+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:45:53.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.030+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:45:53.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.074+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:45:53.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.078+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:53.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.086+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:53.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.086+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:53.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.130+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:45:53.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.138+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:45:53.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 247 16 3174131 3174115 803.091 811.938 0.00111049 0.00123335 2024-09-16T03:45:53.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.174+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:45:53.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.190+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:45:53.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.202+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:45:53.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:45:53.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.238+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:45:53.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.242+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:45:53.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.246+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:45:53.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.246+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:45:53.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.258+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:53.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.266+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:45:53.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.286+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:45:53.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.298+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:45:53.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.310+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:45:53.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.342+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:45:53.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.346+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:45:53.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.354+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:45:53.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.374+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:45:53.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.382+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:53.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:45:53.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.406+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:45:53.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.422+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:45:53.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.434+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:45:53.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.438+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:45:53.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.462+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:45:53.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.470+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:45:53.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.486+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:45:53.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.486+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:45:53.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.514+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:45:53.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.518+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:45:53.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.518+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:45:53.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.526+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:45:53.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.546+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:45:53.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.558+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:45:53.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.566+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:45:53.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.578+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:45:53.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.586+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:45:53.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.586+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:45:53.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.598+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:45:53.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.606+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:45:53.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.622+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:45:53.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.622+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:45:53.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.646+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:45:53.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.662+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:45:53.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.670+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:45:53.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.686+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:45:53.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.690+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:45:53.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.698+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:45:53.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.722+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:53.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.742+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:45:53.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.742+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:53.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.766+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:45:53.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.774+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:45:53.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.790+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:53.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.794+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:45:53.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:45:53.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.810+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:45:53.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.810+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:45:53.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.838+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:45:53.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.842+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:45:53.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.842+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:45:53.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.854+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:45:53.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.870+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:53.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:45:53.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.890+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:53.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.902+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:45:53.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.918+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:45:53.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.930+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:45:53.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.946+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:45:53.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.950+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:53.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.978+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:45:53.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:53.994+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:45:54.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.010+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:45:54.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.022+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:45:54.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.042+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:45:54.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.042+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:45:54.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.054+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:45:54.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.058+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:45:54.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.062+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:45:54.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.090+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:45:54.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.094+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:45:54.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.110+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:45:54.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.118+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:45:54.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.130+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:45:54.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.142+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab8364:::benchmark_data_smithi138_27857_object3467:head, will try copies on 3,4 2024-09-16T03:45:54.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.154+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:45:54.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.158+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:45:54.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 248 16 3187010 3186994 803.098 804.938 0.000805268 0.00123333 2024-09-16T03:45:54.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.178+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:54.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.190+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:45:54.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.206+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:45:54.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.314+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:45:54.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.326+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:45:54.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.330+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:54.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.346+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:45:54.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.346+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:45:54.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.350+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:45:54.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.370+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:45:54.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.406+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:45:54.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.414+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:45:54.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.422+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:54.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.426+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:45:54.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.446+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:54.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.462+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:45:54.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.466+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:54.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.474+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:45:54.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.482+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:45:54.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.494+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:45:54.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.498+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:45:54.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.510+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:45:54.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.522+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:45:54.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.538+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:45:54.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.542+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:45:54.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.546+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:45:54.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.558+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:45:54.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.566+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:45:54.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.578+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:45:54.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.590+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:45:54.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.610+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:54.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.614+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:45:54.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.638+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:54.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.658+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:45:54.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.666+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:45:54.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.674+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:45:54.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.678+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:45:54.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.686+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:45:54.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:54.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.722+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:45:54.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.734+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:45:54.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.742+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:45:54.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.742+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:45:54.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.754+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:45:54.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.758+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:45:54.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.758+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:45:54.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.794+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:45:54.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.810+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:45:54.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.810+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:45:54.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.814+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:45:54.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.834+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:45:54.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.854+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:45:54.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:45:54.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.886+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:45:54.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.894+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:45:54.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.906+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:45:54.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.934+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:45:54.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:45:54.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.954+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:54.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.958+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:45:54.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.978+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:45:54.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.986+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:45:55.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:54.994+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:55.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.006+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:45:55.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.038+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:45:55.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.046+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:45:55.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.062+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:55.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.070+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:45:55.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:45:55.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.090+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:45:55.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.094+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:45:55.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.098+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:45:55.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.110+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:45:55.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.134+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:45:55.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.150+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:45:55.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.154+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:45:55.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 249 16 3199030 3199014 802.889 751.25 0.000868709 0.00123366 2024-09-16T03:45:55.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.174+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:45:55.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.190+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:45:55.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.190+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:45:55.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.206+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:45:55.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.214+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:45:55.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.222+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:45:55.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.226+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:45:55.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.230+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:45:55.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.234+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:45:55.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.242+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:45:55.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.254+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:45:55.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.262+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:45:55.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.262+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:45:55.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.290+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:45:55.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.314+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:45:55.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.342+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:45:55.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.354+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:45:55.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.366+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:45:55.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.366+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:45:55.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.394+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:45:55.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.394+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:45:55.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.410+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:45:55.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.426+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:45:55.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.442+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:45:55.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.466+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:45:55.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.470+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:45:55.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.474+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:45:55.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.482+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:45:55.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.494+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:45:55.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.502+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:45:55.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.510+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:45:55.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.518+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:45:55.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.542+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:45:55.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.542+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:45:55.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.546+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:45:55.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.578+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:45:55.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.582+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:45:55.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.598+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:45:55.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.606+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:45:55.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.606+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:55.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.606+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:45:55.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.638+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:45:55.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.638+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:45:55.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.642+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:45:55.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.646+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:45:55.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.658+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:55.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.682+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:45:55.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.714+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:55.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.730+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:45:55.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.734+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:45:55.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.758+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:45:55.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.758+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:45:55.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.758+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:45:55.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.770+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:45:55.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.782+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:45:55.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.810+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:45:55.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.822+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:45:55.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.822+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:55.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.842+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:55.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.862+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:45:55.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.886+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:45:55.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.894+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:45:55.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.902+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:45:55.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.934+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:45:55.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.966+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:45:55.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.966+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:45:55.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.970+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:45:55.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.974+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:45:55.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:55.974+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:45:56.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.002+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:45:56.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:45:56.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.006+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:45:56.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.046+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:45:56.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.054+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:45:56.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.062+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:45:56.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.070+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:45:56.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.082+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:45:56.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.082+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:45:56.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:45:56.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.126+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:45:56.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.130+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:45:56.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.146+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:45:56.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.146+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:45:56.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.162+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:45:56.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.162+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:45:56.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.170+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:45:56.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 250 16 3211779 3211763 802.865 796.812 0.00101367 0.00123369 2024-09-16T03:45:56.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.194+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:45:56.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.210+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:45:56.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.222+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:45:56.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.222+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:45:56.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.222+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:45:56.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.242+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286e6e19:::benchmark_data_smithi138_27857_object658:head, will try copies on 0,4 2024-09-16T03:45:56.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.254+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:45:56.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.258+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:45:56.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.266+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:45:56.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.286+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:45:56.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.302+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:45:56.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.306+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:45:56.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.326+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:45:56.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.338+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:56.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.354+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:45:56.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.362+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:56.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.378+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:45:56.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.382+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:56.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.382+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:45:56.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.394+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:45:56.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.402+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:45:56.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.406+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:45:56.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.410+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:45:56.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.434+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:45:56.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.434+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:45:56.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.446+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:45:56.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.450+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:45:56.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.466+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:45:56.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.482+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:45:56.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.494+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:45:56.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.510+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:56.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.514+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:45:56.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.514+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:45:56.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.542+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:45:56.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.546+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:45:56.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.554+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:45:56.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.558+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:56.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.558+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:45:56.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.578+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:45:56.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.594+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:45:56.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.598+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:45:56.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.610+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:45:56.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.614+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:45:56.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.646+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:45:56.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.650+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:45:56.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.654+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:45:56.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.662+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:56.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.682+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:45:56.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.706+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:45:56.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.718+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:45:56.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.722+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:45:56.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.750+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:45:56.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.754+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:56.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.762+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:45:56.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.786+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:45:56.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.798+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:45:56.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.798+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:45:56.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.806+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:45:56.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.818+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:45:56.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.834+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:45:56.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.838+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:45:56.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.850+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:45:56.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.858+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:56.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.878+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:45:56.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.886+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:56.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.898+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:45:56.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.898+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:45:56.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.906+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:45:56.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.914+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:45:56.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.922+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:45:56.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.930+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:45:56.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.930+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:45:56.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.930+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:45:56.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.942+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:45:56.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:45:56.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:56.974+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:45:57.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.002+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:45:57.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.006+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:57.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.054+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:45:57.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.074+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:45:57.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.078+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:45:57.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.086+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:45:57.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.090+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:45:57.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.094+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:57.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.126+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:45:57.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.134+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:45:57.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.138+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:45:57.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.142+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:45:57.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.154+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:45:57.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.170+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:45:57.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 251 16 3224466 3224450 802.825 792.938 0.000569722 0.00123374 2024-09-16T03:45:57.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.194+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:45:57.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.198+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:45:57.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.218+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:45:57.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.218+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:45:57.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.218+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:45:57.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.226+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:45:57.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:45:57.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.258+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:45:57.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.274+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:45:57.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.278+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:45:57.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.278+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:45:57.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.302+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:45:57.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.318+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:45:57.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.334+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:45:57.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.350+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:45:57.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.350+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:57.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.358+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:45:57.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.366+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:45:57.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.370+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:45:57.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.394+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:45:57.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.430+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:57.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.430+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:45:57.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.446+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:45:57.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.458+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:45:57.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.478+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:45:57.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.486+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:45:57.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.490+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:45:57.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.490+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:45:57.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.502+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:45:57.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.506+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:45:57.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.518+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:45:57.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.518+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:45:57.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.558+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:45:57.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.570+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:45:57.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.574+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:45:57.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.582+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:45:57.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.582+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:45:57.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.594+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:45:57.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.594+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:57.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.602+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:45:57.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.626+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:45:57.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.630+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:45:57.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.634+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:57.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.658+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:45:57.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.662+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:45:57.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.666+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:45:57.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.674+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:45:57.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.686+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:45:57.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.714+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:45:57.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.730+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:45:57.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.730+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:45:57.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.762+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:45:57.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.766+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:45:57.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.770+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:45:57.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.786+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:45:57.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.794+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:45:57.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.798+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:45:57.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.802+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:45:57.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.806+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:57.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.822+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:45:57.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.826+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:45:57.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.846+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:45:57.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.854+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:45:57.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.882+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:57.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.898+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:45:57.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.914+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:45:57.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.934+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:45:57.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.934+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:45:57.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:45:57.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.962+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:45:57.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.982+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:57.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.982+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:45:57.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.990+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:45:57.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:57.990+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:45:58.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.022+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:45:58.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.026+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:45:58.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.038+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:45:58.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.038+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:45:58.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.050+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:45:58.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.066+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:45:58.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.074+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:45:58.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.078+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:45:58.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.082+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:45:58.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.086+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:45:58.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.122+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:45:58.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.122+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:45:58.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.130+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:45:58.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.130+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:45:58.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.142+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:45:58.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.158+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:45:58.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.170+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:58.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 252 16 3237549 3237533 802.884 817.688 0.000688676 0.00123365 2024-09-16T03:45:58.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.202+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:45:58.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.202+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:45:58.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.206+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:45:58.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.218+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:45:58.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.230+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:45:58.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:45:58.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.246+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:45:58.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.286+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:45:58.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.290+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:45:58.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.306+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:58.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.310+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:45:58.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.322+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:45:58.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.326+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:45:58.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.342+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:45:58.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.346+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:45:58.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.354+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:45:58.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.358+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:45:58.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.362+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:45:58.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.362+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:45:58.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.386+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:45:58.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.386+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:58.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:45:58.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.430+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:45:58.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.434+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:45:58.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.434+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:45:58.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.438+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:45:58.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.470+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:45:58.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.478+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:45:58.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.490+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:45:58.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.498+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:45:58.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.498+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:45:58.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.534+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:45:58.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.542+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:45:58.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.562+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:45:58.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.574+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:45:58.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:45:58.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.594+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:45:58.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.610+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:45:58.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.622+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:45:58.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.630+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:45:58.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.634+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:45:58.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.646+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:45:58.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.658+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:45:58.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.674+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:45:58.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.678+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:45:58.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.686+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:45:58.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.698+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:45:58.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.702+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:45:58.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.710+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:45:58.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.710+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:45:58.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.718+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:45:58.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.754+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:45:58.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.754+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:45:58.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.762+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:58.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.762+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:45:58.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.774+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:45:58.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.782+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:45:58.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.810+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:45:58.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.818+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:45:58.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.826+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:45:58.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.842+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:45:58.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.846+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:45:58.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.846+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:45:58.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.862+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:45:58.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.862+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:45:58.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.890+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:45:58.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.890+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:45:58.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.890+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:45:58.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.894+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:45:58.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.894+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:45:58.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.942+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:45:58.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.954+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:45:58.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.962+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:45:58.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:58.978+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:45:59.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.010+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:45:59.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.022+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:45:59.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.038+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:45:59.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.050+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:45:59.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.066+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:45:59.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.066+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:45:59.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.078+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:45:59.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.098+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:45:59.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.106+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:45:59.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.110+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:45:59.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.118+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:45:59.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.122+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:45:59.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.122+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:45:59.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.138+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:45:59.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.166+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:45:59.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.170+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:45:59.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 253 16 3250380 3250364 802.88 801.938 0.00153439 0.00123366 2024-09-16T03:45:59.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.174+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:45:59.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.202+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:45:59.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.214+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:45:59.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.218+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:45:59.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.222+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:45:59.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.226+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:45:59.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.234+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:45:59.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.362+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:45:59.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.374+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:45:59.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.390+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:45:59.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.398+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:45:59.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.426+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:45:59.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.430+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:45:59.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.434+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:45:59.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.442+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:45:59.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.474+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:45:59.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.490+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:45:59.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.490+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:45:59.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.502+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:45:59.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.506+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:45:59.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.542+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:45:59.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.542+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:45:59.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.566+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:45:59.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.570+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:45:59.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.574+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:45:59.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.586+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:45:59.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.590+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:45:59.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.610+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:45:59.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.622+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:45:59.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.634+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:45:59.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.638+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:45:59.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.658+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:45:59.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.682+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:45:59.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.682+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:45:59.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.682+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:45:59.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.710+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:45:59.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.722+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:45:59.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.734+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:45:59.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.738+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:45:59.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.738+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:45:59.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.750+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:45:59.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.786+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:45:59.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.790+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:45:59.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.794+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:45:59.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.802+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:45:59.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.810+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:45:59.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.818+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:45:59.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.822+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:45:59.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.846+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:45:59.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.866+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:45:59.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.882+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:45:59.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.894+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:45:59.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.902+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:45:59.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.910+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:45:59.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.938+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:45:59.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.942+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:45:59.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.942+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:45:59.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.954+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:45:59.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.974+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:45:59.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.982+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:45:59.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:45:59.982+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:00.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.010+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:46:00.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.022+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:46:00.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.034+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:00.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.034+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:46:00.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.070+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:46:00.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.074+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:46:00.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.078+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:46:00.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.082+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:46:00.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.086+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:00.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.118+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:46:00.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.118+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:46:00.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.126+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:46:00.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.142+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:00.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.158+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:46:00.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.166+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:00.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 254 16 3261670 3261654 802.496 705.625 0.00103245 0.00123426 2024-09-16T03:46:00.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.186+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:46:00.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.194+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:46:00.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.226+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:00.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:46:00.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.234+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:46:00.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.246+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:00.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.254+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:00.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.274+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:00.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.274+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:46:00.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.278+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:46:00.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.286+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:00.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.306+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:00.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.314+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:46:00.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.326+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:46:00.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.326+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:00.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.342+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:46:00.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.354+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:00.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.370+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:00.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.382+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:00.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.394+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:46:00.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.402+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:46:00.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.410+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:46:00.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.422+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:00.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.430+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:46:00.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.438+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:46:00.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.458+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:46:00.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.458+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:00.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.462+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:46:00.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.478+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:46:00.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.498+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:46:00.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.510+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:46:00.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.522+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:00.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.526+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:46:00.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.534+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:00.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:46:00.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.542+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:46:00.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.546+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:00.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:00.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.582+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:46:00.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.586+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:46:00.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.606+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:00.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.610+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:46:00.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.630+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:46:00.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.630+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:00.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.638+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:46:00.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.638+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:46:00.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.650+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:46:00.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.666+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:46:00.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.690+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:46:00.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.694+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:46:00.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.698+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:46:00.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.702+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:00.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.718+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:46:00.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.738+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:00.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.746+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:00.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.754+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:46:00.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.770+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:00.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.786+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:46:00.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.822+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:00.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.826+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:46:00.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.846+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:00.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.874+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:46:00.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.874+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:00.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.882+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:46:00.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.898+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:46:00.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.918+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:00.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.918+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:46:00.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.934+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:46:00.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.938+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:00.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.962+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:46:00.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.974+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:46:00.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.982+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:01.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:00.994+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:46:01.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.006+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:46:01.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.018+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:01.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.050+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:46:01.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.058+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:01.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.090+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:01.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.110+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:46:01.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.130+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:46:01.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.138+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:46:01.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.150+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:01.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.158+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:01.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.166+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:46:01.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.166+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:46:01.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 255 16 3274835 3274819 802.576 822.812 0.000779525 0.00123414 2024-09-16T03:46:01.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.174+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:46:01.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:01.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.230+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:01.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.250+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:01.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.266+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:01.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.282+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:46:01.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.286+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:46:01.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.286+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:46:01.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.294+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:46:01.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.306+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:01.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.326+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:46:01.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.374+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:01.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.378+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:46:01.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.390+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:46:01.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.390+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:01.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.406+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:46:01.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.422+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:46:01.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.426+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:01.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.430+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:46:01.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.442+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:01.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.450+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:46:01.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.450+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:46:01.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.478+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:46:01.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.486+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:01.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.494+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:46:01.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.502+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:46:01.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.506+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:01.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.518+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:01.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.522+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:46:01.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.530+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:46:01.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.542+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:01.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.546+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:01.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.550+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:46:01.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.554+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:46:01.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.562+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:46:01.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.570+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:46:01.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.598+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:46:01.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.602+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:46:01.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.614+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:46:01.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.618+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:46:01.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.622+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:46:01.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.646+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:46:01.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.650+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:01.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.658+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:01.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.690+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:46:01.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.706+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:01.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.706+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:46:01.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.710+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:46:01.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.726+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:46:01.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.730+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:46:01.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.734+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:46:01.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.758+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:01.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.778+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:01.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.798+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:01.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:46:01.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:46:01.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.830+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:46:01.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.834+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:46:01.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.842+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:46:01.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.858+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:46:01.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.870+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:01.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.878+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:01.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.882+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:46:01.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.902+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:01.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.910+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:01.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.942+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:46:01.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.950+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:01.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:46:01.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.962+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:46:01.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.966+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:46:01.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.978+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:46:01.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:01.990+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:46:02.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.002+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:02.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.018+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:46:02.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.022+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:46:02.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.022+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:46:02.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.026+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:02.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.058+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:46:02.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.074+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:02.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.082+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:46:02.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.094+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:46:02.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.106+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:46:02.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.106+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:02.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.106+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:46:02.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.122+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:46:02.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.138+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:02.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.142+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:02.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.154+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:02.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.158+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:46:02.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.166+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:46:02.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 256 16 3287585 3287569 802.553 796.875 0.000680341 0.00123416 2024-09-16T03:46:02.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.178+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:46:02.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.178+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:02.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.182+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:46:02.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.194+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:46:02.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.214+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:02.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.226+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:46:02.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.250+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:46:02.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.250+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:46:02.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.254+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:46:02.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.258+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:46:02.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.258+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:02.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.278+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:46:02.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.286+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:02.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.298+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:46:02.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.298+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:46:02.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.326+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:46:02.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.330+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:46:02.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.334+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:46:02.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.354+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:02.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.358+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:46:02.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.366+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:46:02.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.374+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:46:02.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.386+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:46:02.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.394+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:46:02.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.406+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:02.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.418+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:46:02.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.426+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:46:02.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.442+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:46:02.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.462+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:02.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.462+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:46:02.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.478+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:46:02.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.490+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:46:02.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.490+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:46:02.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.490+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:46:02.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.506+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:46:02.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.522+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:46:02.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.534+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:46:02.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.538+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:02.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.550+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:46:02.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.570+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:46:02.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.582+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:46:02.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.590+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:02.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.590+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:46:02.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.598+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:46:02.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.606+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:46:02.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.638+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:02.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.642+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:46:02.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.654+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:46:02.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.666+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:46:02.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.682+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:46:02.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.714+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:46:02.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.718+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:46:02.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.734+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:46:02.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.746+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:46:02.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.750+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:46:02.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.774+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:46:02.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.802+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:46:02.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.802+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:02.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.826+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:02.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.838+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:02.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.838+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:46:02.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.838+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:46:02.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.854+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:46:02.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.874+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:46:02.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.874+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:46:02.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.886+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:46:02.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.906+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:46:02.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.910+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:02.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.918+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:02.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.946+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:02.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.954+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:46:02.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.974+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:02.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.990+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:02.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:02.994+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:46:03.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.002+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:03.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.010+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:46:03.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.022+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:46:03.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.050+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:46:03.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.050+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:46:03.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.054+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:03.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.058+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:03.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.094+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:46:03.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.094+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:46:03.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.102+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:03.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.110+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:46:03.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.118+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:46:03.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.146+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:46:03.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.166+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:46:03.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.170+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:03.177 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 257 16 3300537 3300521 802.58 809.5 0.000715499 0.00123414 2024-09-16T03:46:03.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.186+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51c7cc39:::benchmark_data_smithi138_27857_object961:head, will try copies on 3,4 2024-09-16T03:46:03.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.202+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:46:03.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:46:03.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.226+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:46:03.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.234+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:46:03.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.242+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:46:03.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.254+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:46:03.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.270+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:03.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.278+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:46:03.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.286+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:46:03.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.302+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:46:03.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.306+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:03.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.330+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:46:03.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.346+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:46:03.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.354+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:46:03.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.358+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:46:03.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.378+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:46:03.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.382+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:46:03.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.394+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:46:03.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.402+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:46:03.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.402+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:46:03.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.406+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:03.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.430+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:46:03.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.438+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:03.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.446+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:46:03.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.466+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ebe262:::benchmark_data_smithi138_27857_object1127:head, will try copies on 3,4 2024-09-16T03:46:03.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.470+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:46:03.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.470+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:03.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.498+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:03.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.510+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:46:03.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.518+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:46:03.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.534+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:46:03.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.538+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:46:03.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.550+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:03.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.554+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:03.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.570+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:03.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.574+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:46:03.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.574+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:46:03.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.582+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:46:03.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.590+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:03.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.606+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:46:03.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.642+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:03.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.658+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:03.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.666+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:03.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.678+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:46:03.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.682+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:46:03.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.686+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:46:03.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.718+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:46:03.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.722+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:46:03.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.722+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:46:03.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.738+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:03.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.746+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:46:03.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.754+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:46:03.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.758+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:03.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.762+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:46:03.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.770+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:46:03.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.786+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:46:03.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.790+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:46:03.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.794+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:46:03.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.818+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:46:03.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.822+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:46:03.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.826+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:03.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.834+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:46:03.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.854+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:03.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.862+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:46:03.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.874+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:46:03.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.874+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:46:03.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.886+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:46:03.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.902+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:46:03.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.910+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:03.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.914+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:03.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.930+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:46:03.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.958+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:46:03.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.962+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:46:03.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.966+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:46:03.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.966+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:46:04.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.994+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:46:04.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:03.998+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:46:04.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.014+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:04.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.046+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:46:04.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.050+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:46:04.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.054+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:46:04.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.070+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:46:04.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.086+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:46:04.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.090+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:04.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.106+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:46:04.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.114+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:46:04.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.134+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:46:04.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.142+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:46:04.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.154+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:46:04.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.158+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:04.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 258 15 3313264 3313249 802.552 795.5 0.00137296 0.00123417 2024-09-16T03:46:04.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.178+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:46:04.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.202+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:04.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.206+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:04.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.218+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:46:04.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.234+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:04.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.234+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:46:04.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.250+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:46:04.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.250+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:46:04.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:46:04.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.269+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:46:04.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.277+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:46:04.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.289+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:04.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.361+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:04.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.361+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:46:04.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.385+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91307b25:::benchmark_data_smithi138_27857_object4024:head, will try copies on 0,4 2024-09-16T03:46:04.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.385+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:46:04.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.393+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:46:04.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:46:04.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.433+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:46:04.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.441+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:04.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.449+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:46:04.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.469+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:04.475 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.469+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:46:04.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.477+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:46:04.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:04.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.525+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:04.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.549+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:04.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.565+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:46:04.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.569+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:04.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.569+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:04.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:46:04.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:46:04.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.581+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:46:04.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.605+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:46:04.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:04.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.633+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:46:04.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.645+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:04.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:46:04.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.669+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:04.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.685+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:46:04.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.701+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:46:04.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.705+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:04.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:04.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:46:04.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.733+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:04.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.757+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:46:04.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.757+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:46:04.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.761+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:46:04.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:46:04.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.797+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:46:04.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.797+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:46:04.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.817+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:04.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.821+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:46:04.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:46:04.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.829+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:46:04.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.861+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:46:04.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.869+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:46:04.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:04.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.893+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:04.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.893+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:04.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:04.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.905+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:04.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.913+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:46:04.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.933+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:46:04.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.937+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:46:04.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.945+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:46:04.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:46:04.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.973+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:46:04.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.977+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:04.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.989+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:04.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:04.993+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:46:05.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.013+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:46:05.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.013+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:46:05.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.025+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:46:05.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:05.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:05.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.037+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:46:05.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.049+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:05.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.077+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:46:05.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.097+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:46:05.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.101+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:46:05.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.109+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:46:05.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:46:05.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:05.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:46:05.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.157+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:46:05.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:46:05.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 259 16 3325552 3325536 802.418 767.938 0.000613478 0.00123439 2024-09-16T03:46:05.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:46:05.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:05.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:05.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.225+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:05.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:05.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.229+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:05.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.261+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:05.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.277+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:46:05.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.301+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:46:05.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.309+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:05.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.329+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:46:05.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.345+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:46:05.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.361+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:46:05.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.381+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:05.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.393+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:46:05.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:05.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.409+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:46:05.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.421+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:46:05.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.437+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:05.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.465+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:05.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:05.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.497+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:46:05.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:05.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.517+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:05.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:46:05.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:46:05.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.553+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:46:05.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.561+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:46:05.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.565+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:05.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:46:05.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.605+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:46:05.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:05.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.613+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:05.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.617+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:05.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.629+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:05.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:46:05.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:46:05.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.677+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:46:05.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.681+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:46:05.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.713+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:46:05.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:46:05.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.721+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:46:05.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.757+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:46:05.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.757+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:46:05.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:46:05.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.761+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:46:05.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.769+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:46:05.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:46:05.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.809+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:46:05.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.825+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:46:05.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.825+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:05.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:46:05.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.841+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:46:05.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.845+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:05.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.869+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:05.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:46:05.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.901+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:05.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:46:05.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.913+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:46:05.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.921+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:05.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.933+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:46:05.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.937+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:46:05.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:46:05.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.953+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:46:05.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.969+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:46:05.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.973+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:46:05.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:05.973+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:46:06.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.001+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:46:06.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:46:06.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.001+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:46:06.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.005+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:46:06.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:46:06.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:46:06.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.073+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:06.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.089+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:46:06.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.093+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:46:06.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:46:06.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.105+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:46:06.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.121+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:46:06.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.137+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:06.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.157+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:46:06.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:46:06.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:46:06.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:46:06.178909+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123419 2024-09-16T03:46:06.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:46:06.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 260 16 3338935 3338919 802.549 836.438 0.00113656 0.00123419 2024-09-16T03:46:06.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:46:06.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.217+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:06.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.237+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:46:06.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:46:06.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.257+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:46:06.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.273+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:46:06.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.281+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:46:06.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:06.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.309+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:46:06.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.317+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:46:06.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.345+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:46:06.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:06.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:46:06.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.377+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:46:06.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.405+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:46:06.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.405+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:06.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.425+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:46:06.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.437+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:46:06.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.453+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:46:06.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.453+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:06.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.457+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:46:06.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.477+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:06.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.481+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:46:06.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.493+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:06.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.497+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:46:06.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.509+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:46:06.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.513+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:46:06.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.537+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:46:06.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.545+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:46:06.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.545+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:46:06.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:46:06.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.569+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:06.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.577+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:46:06.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.581+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:06.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:06.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:06.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.629+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:46:06.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.633+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:46:06.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.645+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:46:06.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.649+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:46:06.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:46:06.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.681+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:46:06.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.689+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:46:06.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.693+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:46:06.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.693+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:46:06.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.697+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:06.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.729+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:46:06.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:06.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.737+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:46:06.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.745+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:46:06.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:06.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:06.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:06.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.801+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:46:06.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.813+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:46:06.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:46:06.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.833+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:46:06.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.833+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:06.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.833+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:46:06.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.853+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:46:06.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.857+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:46:06.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.873+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:06.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.881+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:06.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.893+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:46:06.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.913+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:06.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.925+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:46:06.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.925+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:46:06.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:06.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:46:06.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.957+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:06.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:46:06.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:06.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.989+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:46:06.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:06.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:46:07.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.021+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:07.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.029+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:07.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.061+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:46:07.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.061+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:46:07.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.077+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:07.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.077+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:07.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:46:07.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.101+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:07.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:07.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.145+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:07.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:07.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.165+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:46:07.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.169+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:46:07.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 261 16 3351945 3351929 802.589 813.125 0.00116837 0.00123412 2024-09-16T03:46:07.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.177+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:46:07.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.225+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:07.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:46:07.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.245+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:46:07.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.249+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:46:07.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.257+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:07.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.257+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:46:07.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:46:07.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.277+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:46:07.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:46:07.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.277+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:46:07.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.321+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:46:07.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.325+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:46:07.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.329+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:46:07.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:07.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:46:07.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:07.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.361+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:07.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.377+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:46:07.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.385+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:07.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.385+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:07.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:46:07.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.417+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:46:07.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.425+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:07.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.425+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:46:07.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.433+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:46:07.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:46:07.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:46:07.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.481+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:46:07.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.509+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:46:07.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.509+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:46:07.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.513+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:07.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:46:07.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:46:07.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.569+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:07.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:46:07.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.589+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:46:07.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.593+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:46:07.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:46:07.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.633+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:46:07.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.637+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:46:07.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.637+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:07.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.645+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:46:07.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.661+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:46:07.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.669+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:07.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:07.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.701+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:07.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.709+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:46:07.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.725+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:46:07.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:46:07.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.737+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:07.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:46:07.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.753+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:07.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.761+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:07.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.761+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:46:07.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:46:07.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.789+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:46:07.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.793+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:07.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:46:07.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.821+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:46:07.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.821+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:46:07.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:46:07.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:07.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:46:07.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:07.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.897+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:46:07.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.929+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:46:07.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.945+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:46:07.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.961+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:46:07.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:46:07.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:46:07.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:07.989+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:08.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:46:08.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.017+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:08.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:46:08.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:46:08.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:46:08.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.073+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:46:08.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.081+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:46:08.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.081+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:08.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:46:08.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:08.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.117+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:46:08.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.141+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:08.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.145+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:08.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.149+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:46:08.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 262 16 3365121 3365105 802.669 823.5 0.00062971 0.001234 2024-09-16T03:46:08.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.177+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:46:08.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.177+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:46:08.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.189+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:46:08.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:08.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.205+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:46:08.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.225+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:08.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.229+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:46:08.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.253+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:46:08.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.265+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:08.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.269+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:08.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.285+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:46:08.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.289+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:08.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.301+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:46:08.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.305+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:46:08.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.313+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:46:08.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.337+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:46:08.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:08.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.349+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:08.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:46:08.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.373+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:08.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:08.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.389+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:46:08.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.409+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:46:08.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.429+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:46:08.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.441+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:46:08.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:46:08.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.465+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:46:08.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.477+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:08.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.481+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:46:08.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.509+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:46:08.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:08.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:46:08.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:46:08.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:46:08.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.561+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:46:08.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.569+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:46:08.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:46:08.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.581+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:46:08.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:46:08.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.589+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:08.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:46:08.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:46:08.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:08.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:08.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.673+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:46:08.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.685+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:46:08.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.685+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:46:08.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:08.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:46:08.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.753+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8c66e0:::benchmark_data_smithi138_27857_object1653:head, will try copies on 3,4 2024-09-16T03:46:08.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:46:08.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.781+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:46:08.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.789+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:08.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.805+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:08.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:08.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:08.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.865+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:46:08.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.869+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:46:08.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.881+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:46:08.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.881+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:46:08.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:08.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.901+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:46:08.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.913+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:46:08.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.913+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:46:08.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.933+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:46:08.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.957+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:08.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.961+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:46:08.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.965+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:08.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.969+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:46:08.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.973+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:46:09.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:08.997+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:09.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.005+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:46:09.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.013+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:46:09.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.013+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:46:09.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:09.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.033+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:46:09.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.033+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:46:09.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.057+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:09.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.057+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:09.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:09.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.093+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:46:09.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:46:09.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.101+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:09.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.101+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:46:09.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.121+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:46:09.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.145+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:46:09.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:46:09.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:46:09.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.169+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:09.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 263 15 3378231 3378216 802.732 819.438 0.000838377 0.00123391 2024-09-16T03:46:09.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.189+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:46:09.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.189+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:46:09.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.189+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:46:09.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.205+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:46:09.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:09.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.233+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:46:09.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:46:09.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.265+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:46:09.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.289+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:46:09.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.301+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:46:09.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.309+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:09.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.313+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:46:09.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.321+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:46:09.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:46:09.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:46:09.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.357+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:09.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.377+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:46:09.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.381+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:46:09.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.385+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:46:09.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.409+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:46:09.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.433+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:46:09.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.437+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:46:09.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.441+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:46:09.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.457+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:46:09.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:46:09.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:46:09.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.485+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:09.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:46:09.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:46:09.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.505+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:09.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:09.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:09.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:09.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.565+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:09.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.565+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:09.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.589+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:09.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.593+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:46:09.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.597+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:09.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:46:09.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.633+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:46:09.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.645+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:46:09.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.649+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:46:09.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.649+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:46:09.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.665+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:09.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.677+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:46:09.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:46:09.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:09.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:46:09.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:46:09.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.717+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:46:09.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:46:09.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.769+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:46:09.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:46:09.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.777+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:46:09.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.797+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:09.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:46:09.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:09.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.813+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:09.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:09.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:46:09.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:46:09.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:46:10.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.877+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.889+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.893+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.913+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.929+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.961+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.989+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.989+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:09.993+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.009+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:10.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:46:10.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.041+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:46:10.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:10.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.077+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:10.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.085+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:10.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.093+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:46:10.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.093+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:10.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.109+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:10.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.109+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:46:10.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.125+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:10.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.129+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:46:10.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:46:10.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:10.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:10.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:46:10.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.169+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:46:10.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 264 16 3391158 3391142 802.751 807.875 0.00066218 0.00123387 2024-09-16T03:46:10.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.173+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:46:10.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.189+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:46:10.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.213+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:10.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.217+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:46:10.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.237+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:46:10.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.237+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:46:10.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:10.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.253+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:10.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.261+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:10.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.265+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:46:10.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.289+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:10.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:46:10.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:10.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:46:10.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:10.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.345+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:46:10.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:10.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.365+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:46:10.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.385+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:46:10.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:46:10.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.401+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:10.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.417+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:46:10.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.425+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:10.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.429+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:46:10.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.437+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:46:10.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.441+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:46:10.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:46:10.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.469+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:10.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.473+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:46:10.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.497+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:46:10.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.497+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:10.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:10.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.529+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:10.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:10.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.569+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:46:10.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.569+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:46:10.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:10.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.597+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:10.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.597+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:46:10.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.613+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:10.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.613+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:46:10.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.641+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:46:10.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:46:10.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.661+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:46:10.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.669+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:46:10.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.693+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:46:10.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.701+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:46:10.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.705+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:46:10.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.729+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:46:10.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:46:10.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:46:10.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.773+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:46:10.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.789+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:10.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:46:10.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.805+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:46:10.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.821+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:10.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:46:10.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:46:10.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.857+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:46:10.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:46:10.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.861+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:46:10.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.873+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:46:10.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.881+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:46:10.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.905+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:10.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.917+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:46:10.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.937+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:10.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.945+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:46:10.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:46:10.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.977+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:10.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:46:10.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:10.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:46:11.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:46:11.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.029+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:11.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:46:11.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.053+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:46:11.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:46:11.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.101+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:46:11.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.105+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:11.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.109+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:46:11.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.109+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:46:11.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.121+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:11.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.133+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:46:11.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.145+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:11.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 265 15 3404363 3404348 802.837 825.375 0.00100405 0.00123375 2024-09-16T03:46:11.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.177+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:46:11.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:46:11.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.205+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:46:11.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.221+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:46:11.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.221+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:46:11.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.237+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:11.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.253+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:11.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.289+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:46:11.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.297+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:11.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.297+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:46:11.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.301+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:46:11.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.305+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:46:11.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.317+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:46:11.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.337+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:46:11.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.353+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:46:11.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.365+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:46:11.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.369+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:46:11.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.373+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:46:11.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.373+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:46:11.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.401+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:46:11.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.409+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:11.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.409+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:46:11.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.413+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:11.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.433+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:46:11.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.437+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:11.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:46:11.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.449+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:46:11.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.485+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:46:11.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.497+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:11.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.505+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:46:11.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.533+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:46:11.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:46:11.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:46:11.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:11.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.553+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:11.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.573+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:46:11.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.573+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:11.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.589+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:11.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:11.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:11.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.633+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:11.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.641+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:46:11.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.669+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:46:11.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.677+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:46:11.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:11.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:46:11.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.693+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:11.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.713+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:46:11.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.733+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:46:11.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.741+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:46:11.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.745+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:46:11.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.753+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:46:11.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.757+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:11.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.777+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:46:11.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.785+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:46:11.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.805+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:46:11.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.809+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:46:11.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.809+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:46:11.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:11.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.857+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:46:11.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.873+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:46:11.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:11.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.901+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:46:11.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.905+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:46:11.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.909+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:46:11.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.921+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:46:11.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.929+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:46:11.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.953+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:46:11.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:46:11.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.961+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:11.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.977+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:46:11.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.981+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:11.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:11.985+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:46:12.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.021+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:12.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.029+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:46:12.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.045+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:46:12.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.049+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:46:12.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.057+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:12.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.097+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:12.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:12.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.125+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:46:12.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:12.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.137+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:12.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:12.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:46:12.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.161+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:12.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:46:12.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 266 16 3417330 3417314 802.865 810.375 0.000788355 0.00123369 2024-09-16T03:46:12.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.205+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:12.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.213+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:46:12.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.221+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:46:12.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:12.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.233+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:12.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.245+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:12.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.257+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:46:12.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.277+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:46:12.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.285+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:46:12.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.297+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:46:12.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.301+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:46:12.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.313+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:46:12.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:12.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.333+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:46:12.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.337+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:46:12.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.337+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:46:12.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.349+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:46:12.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.357+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:46:12.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.357+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:12.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:46:12.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.409+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:46:12.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.421+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:12.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.425+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:46:12.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.453+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:46:12.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:46:12.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:12.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:46:12.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.501+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:46:12.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:46:12.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.521+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:46:12.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:12.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.541+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:46:12.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.541+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:46:12.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.565+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:46:12.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.565+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:12.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.573+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:46:12.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.585+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:12.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.589+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:12.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:12.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.613+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:12.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:46:12.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.629+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:46:12.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:12.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.661+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:46:12.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:46:12.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.665+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:46:12.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.709+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:12.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:12.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.721+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:46:12.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.733+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:46:12.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.769+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:46:12.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.769+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:46:12.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.785+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:46:12.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.789+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:12.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.797+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:46:12.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:46:12.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.833+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:46:12.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.837+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:12.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.853+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:12.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.857+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:12.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.857+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:46:12.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.865+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:46:12.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.881+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:46:12.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.885+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:46:12.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.897+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:46:12.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.905+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:46:12.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.921+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:46:12.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:46:12.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:12.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.969+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:46:12.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:46:12.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:46:12.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:12.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.981+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:46:12.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:46:13.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:12.997+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:46:13.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.021+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:13.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.029+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:46:13.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.037+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:13.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.045+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:46:13.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.057+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:46:13.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.065+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:13.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.069+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:46:13.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.085+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:46:13.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.117+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:46:13.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:13.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.125+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:46:13.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:13.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.153+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:46:13.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.165+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:46:13.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:13.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 267 15 3429969 3429954 802.816 790 0.000878211 0.00123378 2024-09-16T03:46:13.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.181+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:46:13.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.189+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:13.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.197+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:46:13.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.197+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:46:13.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.205+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:13.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:13.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.213+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:13.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:13.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.245+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:46:13.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.253+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:46:13.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.273+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:46:13.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.285+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:46:13.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.289+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:46:13.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.293+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:46:13.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.313+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:46:13.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.313+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:46:13.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:46:13.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.325+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:46:13.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.333+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:13.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.341+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:13.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:13.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.373+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:46:13.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.377+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:46:13.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:46:13.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.385+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:46:13.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.401+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:46:13.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.425+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:13.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.441+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:46:13.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:46:13.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:46:13.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.481+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:46:13.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.489+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:13.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.509+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:13.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.513+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:46:13.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:46:13.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.533+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:13.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.545+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:46:13.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.561+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:46:13.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.577+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:13.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.589+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:46:13.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:46:13.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:13.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.609+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:13.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.613+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:13.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.625+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:46:13.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.629+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:13.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.641+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:46:13.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.645+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:46:13.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.657+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:46:13.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.661+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:46:13.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.685+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:13.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.697+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:46:13.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.709+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:13.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.713+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:13.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.717+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:46:13.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:13.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.793+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:46:13.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.801+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:46:13.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:13.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.809+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:13.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.833+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:13.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.837+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:46:13.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.849+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:46:13.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.869+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:46:13.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:13.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.885+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:46:13.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.885+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:46:13.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.921+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:46:13.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.921+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:46:13.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:13.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:13.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:46:13.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.973+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:46:13.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:13.989+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:14.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:14.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.021+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:46:14.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.025+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:14.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:46:14.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.053+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:46:14.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:14.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.077+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:46:14.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:14.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.085+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:46:14.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.117+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:46:14.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.125+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:46:14.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.145+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:46:14.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.153+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:46:14.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:46:14.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 268 16 3442638 3442622 802.775 791.75 0.000731773 0.00123385 2024-09-16T03:46:14.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.177+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:46:14.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.189+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:14.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.205+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:46:14.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:14.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.213+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:46:14.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.229+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:14.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:14.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.269+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:46:14.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:14.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.277+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:46:14.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.289+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:14.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.293+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:46:14.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:14.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.313+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:46:14.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.321+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:46:14.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:14.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.405+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:46:14.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.421+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:14.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.433+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:46:14.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:46:14.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.453+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:46:14.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.453+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:46:14.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.485+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:46:14.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.493+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:46:14.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.525+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:46:14.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.533+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:46:14.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.537+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:14.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.549+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:14.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.565+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:46:14.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:46:14.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.585+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:46:14.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:14.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.621+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:46:14.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:14.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.629+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:46:14.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.645+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:14.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.649+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:14.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.677+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:46:14.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:14.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:46:14.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.689+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:46:14.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.693+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:46:14.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.701+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:14.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.741+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:46:14.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:46:14.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:46:14.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.761+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:14.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.769+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:46:14.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.781+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:46:14.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:46:14.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.813+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:14.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:46:14.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:46:14.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.845+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:14.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.865+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:46:14.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.877+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:46:14.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:46:14.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:46:14.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.905+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:46:14.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.913+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:14.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.933+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:46:14.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.949+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:14.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.953+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:46:14.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.961+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:46:14.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.989+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:46:14.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:14.989+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:15.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.017+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:46:15.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.021+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:46:15.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.045+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:46:15.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.061+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:46:15.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.081+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:46:15.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.081+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:46:15.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:15.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:46:15.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.093+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:15.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.121+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:46:15.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:15.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.141+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:46:15.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.165+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:46:15.178 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 269 16 3454315 3454299 802.503 729.812 0.000914241 0.00123427 2024-09-16T03:46:15.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.173+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:15.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.177+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:15.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.177+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:46:15.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.181+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:46:15.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.189+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:15.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.205+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:46:15.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.209+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:46:15.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.237+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:15.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.261+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:46:15.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:46:15.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.293+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:15.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.297+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:46:15.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.317+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:15.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.325+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:46:15.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.333+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:15.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:46:15.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.345+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:15.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.349+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:46:15.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:15.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.377+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:46:15.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:46:15.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.405+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:15.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.409+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:15.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.413+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:46:15.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.457+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:46:15.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.457+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:46:15.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:46:15.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:46:15.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.497+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:46:15.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.505+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:15.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.509+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:15.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.517+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:46:15.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.537+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:46:15.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.541+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:46:15.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:46:15.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.557+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:15.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.565+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:46:15.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.585+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:15.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.593+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:46:15.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.625+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:46:15.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.625+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:46:15.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.645+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:15.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.649+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:46:15.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:46:15.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.661+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:46:15.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.677+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:46:15.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.705+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:46:15.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:46:15.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.717+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:46:15.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.725+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:46:15.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.753+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:15.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.761+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:15.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.765+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:46:15.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.769+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:46:15.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:46:15.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.789+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:15.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.793+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:46:15.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:15.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.825+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:46:15.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:46:15.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.857+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:46:15.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.869+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:15.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:46:15.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:46:15.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.901+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:46:15.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:46:15.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:46:15.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:46:15.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.973+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:15.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.981+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:46:15.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:15.989+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:46:16.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.013+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:46:16.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.013+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:16.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.017+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:46:16.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.037+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530efe04:::benchmark_data_smithi138_27857_object3642:head, will try copies on 3,4 2024-09-16T03:46:16.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:46:16.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.057+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:16.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:46:16.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:46:16.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.093+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:16.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:16.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.109+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:46:16.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.121+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:46:16.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.125+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:46:16.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:46:16.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.149+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:16.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.153+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:46:16.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:46:16.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 270 15 3467100 3467085 802.49 799.125 0.00297376 0.00123428 2024-09-16T03:46:16.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.177+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:46:16.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.209+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:16.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:46:16.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.221+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:46:16.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.245+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:16.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.257+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:46:16.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.265+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:46:16.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.273+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:16.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.273+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:16.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:16.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.301+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:46:16.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:16.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:46:16.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.333+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:46:16.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:46:16.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.361+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:46:16.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.369+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:46:16.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.377+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:46:16.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.405+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:46:16.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.413+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:46:16.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.425+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:46:16.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.429+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:46:16.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:16.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.493+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:16.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.513+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:46:16.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:46:16.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.529+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:46:16.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.545+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:46:16.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.549+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:46:16.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.561+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:46:16.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.577+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:46:16.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.593+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:16.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.597+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:16.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:46:16.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.629+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:46:16.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.629+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:46:16.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:46:16.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.645+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:46:16.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.657+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:46:16.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.669+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:46:16.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.669+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:46:16.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:46:16.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.673+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:46:16.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.677+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:16.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.709+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:46:16.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.721+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:16.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.737+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:46:16.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.737+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:16.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.753+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:46:16.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:46:16.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:16.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.789+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:46:16.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.801+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:46:16.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:16.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.845+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:46:16.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.861+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:16.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.865+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:46:16.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:46:16.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:46:16.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:46:16.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:46:16.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.961+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:46:16.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.961+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:46:16.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.977+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:46:17.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:16.997+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:46:17.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:46:17.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.005+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:46:17.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.005+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:46:17.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.029+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:46:17.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:46:17.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.073+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:17.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.073+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:46:17.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.081+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:46:17.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:46:17.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.137+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:17.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.149+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:46:17.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.161+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:17.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:46:17.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 271 16 3480354 3480338 802.586 828.312 0.000952926 0.00123413 2024-09-16T03:46:17.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.173+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:46:17.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:46:17.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.193+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:46:17.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.201+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:46:17.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.229+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:46:17.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.237+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:46:17.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:46:17.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.249+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:46:17.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.265+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:46:17.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:46:17.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:46:17.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.301+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:17.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.317+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:17.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.317+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:17.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.321+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:46:17.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.377+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:46:17.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.405+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:46:17.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:46:17.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.433+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:46:17.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.441+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:46:17.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.457+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:46:17.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:46:17.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.469+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:46:17.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:46:17.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:17.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.485+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:46:17.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.497+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:17.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:17.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.513+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:46:17.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:17.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:17.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.545+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:46:17.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.545+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:17.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:17.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.581+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:46:17.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.593+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:17.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:46:17.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.609+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:46:17.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:46:17.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:17.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.641+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:46:17.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.661+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:46:17.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.665+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:17.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:17.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.721+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:17.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.725+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:46:17.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.741+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:17.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.741+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:46:17.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.785+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:46:17.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.801+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:46:17.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.825+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:17.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.829+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:46:17.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.849+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:17.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.853+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:46:17.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.869+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:17.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.869+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:46:17.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.881+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:46:17.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.881+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:17.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.909+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:17.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.937+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:17.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.937+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:46:17.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:46:17.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.945+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:17.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.969+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:46:17.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.981+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:46:17.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:17.993+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:46:18.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.009+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:18.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.017+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:18.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.021+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:46:18.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:46:18.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:18.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.053+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:46:18.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.065+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:46:18.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.065+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:18.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.089+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:46:18.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.089+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:18.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.105+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:18.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.105+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:18.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:18.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.145+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:46:18.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.149+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:46:18.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 272 16 3493605 3493589 802.679 828.188 0.000892814 0.00123399 2024-09-16T03:46:18.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.177+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:46:18.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:46:18.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.201+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:46:18.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a03813f:::benchmark_data_smithi138_27857_object971:head, will try copies on 3,4 2024-09-16T03:46:18.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:46:18.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.249+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:46:18.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.257+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:18.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:18.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.297+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:46:18.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.305+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:18.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.309+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:46:18.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:18.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.337+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:18.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.353+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:46:18.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.353+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:18.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.353+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:46:18.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.357+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:46:18.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:46:18.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.393+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:18.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:46:18.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.425+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:18.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.429+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:46:18.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.433+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:18.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:46:18.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.457+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:46:18.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.465+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:18.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.477+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:46:18.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:46:18.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:46:18.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.505+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:46:18.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:46:18.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:18.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.545+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:46:18.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.561+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:18.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:18.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.585+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:18.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.609+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:18.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.613+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:18.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.617+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:46:18.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.625+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:46:18.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.637+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:46:18.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:46:18.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:46:18.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:46:18.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:46:18.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.685+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:46:18.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:18.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.729+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:18.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:18.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.737+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:18.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.769+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:18.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:46:18.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:18.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.797+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:46:18.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:46:18.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.809+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:18.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:46:18.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.821+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:46:18.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.837+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:18.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.845+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:46:18.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.865+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:46:18.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:18.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.885+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:46:18.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.893+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:18.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:18.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.909+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:46:18.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:46:18.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.921+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:18.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:18.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.961+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:46:18.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.961+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:46:18.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:18.973+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:19.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:19.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.013+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:46:19.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:19.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:19.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.057+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:46:19.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.065+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:46:19.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.065+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:46:19.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.089+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:46:19.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.105+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:46:19.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.109+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:19.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.117+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:46:19.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.117+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:19.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.149+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:46:19.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:46:19.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 273 16 3506550 3506534 802.703 809.062 0.000688008 0.00123394 2024-09-16T03:46:19.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.177+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:19.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:46:19.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.177+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:19.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.189+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:46:19.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.197+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:46:19.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.201+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:46:19.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.209+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:46:19.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.213+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:19.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.217+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:46:19.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.237+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:19.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.241+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:19.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.273+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:46:19.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.285+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:46:19.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.293+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:19.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:19.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.313+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:46:19.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:46:19.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.341+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:46:19.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.349+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:46:19.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.353+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:46:19.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.365+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:19.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.377+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:46:19.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.393+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:46:19.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.397+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:46:19.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.421+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:46:19.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.429+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:46:19.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.449+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:19.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.453+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:46:19.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.477+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:46:19.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.489+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:46:19.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.493+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:19.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:19.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.529+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:46:19.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.529+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:46:19.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.537+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:19.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.553+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:19.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:19.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.581+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:19.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.593+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:46:19.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.617+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:46:19.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.637+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:19.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.645+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:46:19.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.661+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:46:19.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.673+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:19.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.685+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:46:19.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.689+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:46:19.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.689+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:46:19.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:19.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.721+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:19.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:46:19.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.733+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:46:19.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.741+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:46:19.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.741+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:19.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.761+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:46:19.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:19.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.789+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:46:19.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.793+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:46:19.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.801+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:46:19.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.821+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:46:19.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.833+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:19.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:46:19.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:19.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.857+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:46:19.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a261db:::benchmark_data_smithi138_27857_object469:head, will try copies on 0,4 2024-09-16T03:46:19.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.893+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:46:19.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.909+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:46:19.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.913+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:46:19.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:19.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.913+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:46:19.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.945+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:19.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:46:19.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.961+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:19.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.965+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:46:19.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.973+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:46:19.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:19.993+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:46:20.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.021+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:46:20.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:20.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.033+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:20.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:46:20.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.053+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:46:20.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:46:20.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.085+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:46:20.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.089+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:46:20.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:46:20.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.097+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:46:20.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.121+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:46:20.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.141+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:46:20.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:46:20.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:20.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 274 16 3519410 3519394 802.706 803.75 0.000764292 0.00123394 2024-09-16T03:46:20.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:20.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.197+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:46:20.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:20.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:20.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:20.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.229+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:46:20.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.233+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:46:20.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.237+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:20.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.261+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:46:20.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.269+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:46:20.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.269+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:46:20.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.289+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:46:20.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.297+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:46:20.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.313+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:20.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.317+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:46:20.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:46:20.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.333+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:46:20.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:46:20.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.357+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:46:20.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:46:20.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:20.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.409+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:46:20.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:46:20.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.453+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:46:20.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.453+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:46:20.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.469+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:46:20.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.473+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:46:20.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.477+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:46:20.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.481+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:46:20.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:46:20.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.505+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:46:20.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.525+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:20.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.533+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:46:20.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:20.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.541+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:46:20.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:46:20.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:46:20.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.581+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:46:20.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.593+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:46:20.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:46:20.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.609+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:46:20.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.617+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:20.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.629+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:46:20.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.633+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:20.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.649+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:20.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.649+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:46:20.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:20.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:20.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.705+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:46:20.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.721+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:46:20.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.729+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:46:20.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.737+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:20.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:46:20.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.769+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:20.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.777+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:20.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.789+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:46:20.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.797+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:46:20.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.809+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:46:20.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.809+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:20.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.817+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:20.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.841+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:20.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.857+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:46:20.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.861+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:20.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.873+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:46:20.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:46:20.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:46:20.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.901+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:20.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.909+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:46:20.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.921+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:46:20.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.933+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:20.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.961+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:20.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.969+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:46:20.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.977+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:20.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:46:20.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:20.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:46:21.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.005+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:46:21.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.013+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:46:21.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:21.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:46:21.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:46:21.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.053+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:46:21.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.061+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:46:21.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.077+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:46:21.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.085+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:21.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:21.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:21.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.113+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:46:21.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d88919:::benchmark_data_smithi138_27857_object3870:head, will try copies on 2,3 2024-09-16T03:46:21.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.141+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:46:21.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:46:21.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.165+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:46:21.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 275 16 3532577 3532561 802.779 822.938 0.000735363 0.00123382 2024-09-16T03:46:21.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:46:21.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:46:21.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.201+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:46:21.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.205+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:46:21.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:21.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.233+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:21.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.237+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:46:21.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.241+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:46:21.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:21.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.273+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:46:21.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.289+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:46:21.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.297+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:46:21.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.309+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:21.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:46:21.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:21.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.349+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:46:21.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:46:21.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:46:21.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.381+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:21.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.389+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:46:21.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.389+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:46:21.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.397+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:46:21.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.397+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:46:21.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.437+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:21.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.437+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:46:21.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:21.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.485+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:46:21.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:21.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.513+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:46:21.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.529+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:21.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.533+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:21.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.537+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:21.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.553+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:21.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.553+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:21.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:46:21.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.557+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:46:21.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:46:21.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.585+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:46:21.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.609+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:21.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.621+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:46:21.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.653+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:21.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.657+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:46:21.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.657+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:46:21.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.677+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:21.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.693+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:21.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.693+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:21.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.697+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:46:21.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.709+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:46:21.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.713+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:21.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.717+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:46:21.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.717+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:21.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.729+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:46:21.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.757+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:46:21.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.793+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:46:21.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.817+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:21.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.829+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:21.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.833+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:21.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:46:21.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.869+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:46:21.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.877+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:21.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.885+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:21.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.885+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:21.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.917+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:46:21.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.921+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:46:21.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.925+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:46:21.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.929+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:21.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:46:21.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:46:21.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.969+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:46:21.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:21.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:21.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:21.989+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:22.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.005+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:46:22.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.017+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:22.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.025+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:46:22.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:22.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.037+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:46:22.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.049+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:46:22.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:46:22.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:22.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.077+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:22.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:22.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.093+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:46:22.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:22.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:22.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.141+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:46:22.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.149+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:22.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.165+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:46:22.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 276 16 3545397 3545381 802.774 801.25 0.000786004 0.00123384 2024-09-16T03:46:22.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.181+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:46:22.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.189+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:22.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.193+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:22.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.205+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:46:22.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:46:22.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.217+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:46:22.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.221+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:22.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.221+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:46:22.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:22.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.261+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:22.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:46:22.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.305+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:46:22.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.345+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:46:22.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:46:22.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.365+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:22.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.405+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:46:22.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.413+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:46:22.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.429+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:46:22.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.441+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:46:22.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.445+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:22.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:46:22.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.449+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:46:22.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.485+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:46:22.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.493+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:46:22.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.497+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:22.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.497+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:46:22.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.517+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:46:22.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.533+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:46:22.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.537+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:46:22.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.537+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:46:22.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.553+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:46:22.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.565+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:22.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.573+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:46:22.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.581+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:46:22.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.593+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:46:22.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.597+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:46:22.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.605+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:22.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.617+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54b44918:::benchmark_data_smithi138_27857_object2944:head, will try copies on 3,4 2024-09-16T03:46:22.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.625+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:46:22.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.641+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:46:22.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.653+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:22.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.673+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:22.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:46:22.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.685+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:46:22.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:46:22.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.689+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:22.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.697+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:46:22.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:22.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:22.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.769+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:22.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:46:22.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.793+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:22.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.809+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:46:22.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:22.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.821+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:46:22.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:46:22.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.845+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:46:22.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.849+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:22.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.865+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:22.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.869+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:22.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:46:22.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.909+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:22.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:22.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.917+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:22.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.925+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:46:22.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:46:22.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.961+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:46:22.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.973+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:46:22.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.993+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:22.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:46:22.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:22.993+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:23.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.009+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:23.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.021+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:46:23.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.025+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:46:23.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:23.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:23.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.045+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:23.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.085+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:23.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.093+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:46:23.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.097+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:46:23.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:46:23.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.141+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:46:23.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:46:23.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:46:23.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.169+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:46:23.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:46:23.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 277 16 3558572 3558556 802.848 823.438 0.000694589 0.00123372 2024-09-16T03:46:23.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.197+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:46:23.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:46:23.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.201+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:46:23.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.205+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:46:23.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.213+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:23.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.229+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:46:23.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.249+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:46:23.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.285+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:46:23.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.293+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:23.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.297+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:23.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.297+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:46:23.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.317+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:23.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.329+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:23.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.329+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:46:23.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.337+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:46:23.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.337+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:46:23.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.349+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:46:23.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:23.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.381+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:46:23.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:23.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:23.415 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:46:23.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.421+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:46:23.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.461+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:46:23.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:46:23.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.473+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:46:23.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.477+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:23.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.485+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:46:23.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.493+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:23.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.497+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:46:23.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.521+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:23.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.529+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:23.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.545+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:23.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:46:23.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.565+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:46:23.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.565+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:46:23.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.569+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:46:23.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:23.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:46:23.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:23.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.637+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:46:23.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.641+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:23.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.649+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:46:23.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.665+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:46:23.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.669+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:23.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.693+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:46:23.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:46:23.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.701+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:46:23.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.709+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:46:23.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:23.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:46:23.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.753+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:46:23.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.769+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:46:23.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.781+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:46:23.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.789+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:23.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:23.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:23.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.821+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:46:23.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.825+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:23.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.841+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:46:23.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.845+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:46:23.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.861+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:23.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.865+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:46:23.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.865+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:23.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:46:23.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.897+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:46:23.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.901+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:23.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.929+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:46:23.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.937+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:46:23.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.953+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:46:23.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.957+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:46:23.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.973+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:46:24.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:23.997+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:24.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.001+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:46:24.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.005+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f4784:::benchmark_data_smithi138_27857_object3621:head, will try copies on 0,4 2024-09-16T03:46:24.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.009+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:24.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.025+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:46:24.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.029+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:46:24.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.065+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:24.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:46:24.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.069+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:46:24.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.081+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:46:24.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.093+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:24.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.097+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:24.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:46:24.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.105+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:46:24.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:46:24.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.125+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:46:24.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.153+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:46:24.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.161+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:46:24.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 278 15 3571453 3571438 802.856 805.125 0.00160173 0.00123371 2024-09-16T03:46:24.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:46:24.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.185+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:46:24.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.201+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:46:24.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.213+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:46:24.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.225+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:24.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.237+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:24.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.253+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:46:24.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.257+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:46:24.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:46:24.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.297+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:46:24.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:46:24.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.329+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:46:24.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.333+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:46:24.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.445+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:46:24.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.497+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:24.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.513+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:46:24.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.533+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:46:24.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.533+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:24.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:46:24.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.577+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:24.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.585+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ea99ed:::benchmark_data_smithi138_27857_object1972:head, will try copies on 2,3 2024-09-16T03:46:24.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:46:24.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.601+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:46:24.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.605+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:46:24.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.609+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:46:24.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:24.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.633+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:46:24.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.649+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:46:24.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.657+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:46:24.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.661+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:24.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.681+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:46:24.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.693+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:46:24.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.705+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:24.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.709+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:46:24.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.785+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:46:24.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:24.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.817+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:24.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:46:24.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:46:24.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:46:24.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.857+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:46:24.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.869+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:46:24.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.877+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:46:24.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.877+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:24.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.921+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:24.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.921+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:24.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.937+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:24.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:46:24.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.965+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:46:24.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:46:24.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.977+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:24.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.985+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:24.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:24.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:25.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.001+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:25.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:46:25.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.025+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:25.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.069+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:25.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.073+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:46:25.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.073+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:25.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.081+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:46:25.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.101+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:46:25.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.113+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:46:25.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.133+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:46:25.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.153+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:46:25.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.153+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:25.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.161+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:46:25.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.169+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:46:25.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 279 15 3581882 3581867 802.314 651.812 0.000479615 0.00123455 2024-09-16T03:46:25.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.185+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:46:25.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:25.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.201+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:46:25.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.225+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:25.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.229+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:46:25.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.237+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:46:25.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.241+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:46:25.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.245+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:46:25.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.249+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:46:25.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.257+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:46:25.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:46:25.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.289+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:46:25.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.305+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:46:25.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:46:25.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.321+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:25.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.325+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:25.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.333+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:25.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.337+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a95ac7:::benchmark_data_smithi138_27857_object1088:head, will try copies on 0,4 2024-09-16T03:46:25.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:46:25.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.365+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:25.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.385+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:46:25.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.397+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:46:25.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.397+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:46:25.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.401+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:25.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.421+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:25.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.437+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:46:25.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:46:25.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:25.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.445+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:46:25.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.449+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:46:25.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.465+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:25.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.489+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:25.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:46:25.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.533+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:46:25.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:46:25.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.549+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:46:25.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.565+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:25.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.569+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:46:25.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:46:25.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.589+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:46:25.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.609+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:46:25.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:46:25.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:25.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.633+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:46:25.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.637+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:46:25.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.653+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:46:25.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:46:25.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.701+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:46:25.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.701+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:46:25.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:46:25.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.733+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:46:25.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.733+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:46:25.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:46:25.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:46:25.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.761+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:25.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:46:25.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.777+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:46:25.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:25.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.821+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:46:25.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.833+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:46:25.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:46:25.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.853+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:25.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.857+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:46:25.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.869+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:46:25.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.885+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:46:25.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.905+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:46:25.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.937+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:25.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:25.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.969+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:25.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.977+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:46:25.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:25.985+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:46:26.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.009+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:26.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.021+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:46:26.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.029+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:26.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:26.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.069+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:26.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.077+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:46:26.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.093+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:26.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.101+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:26.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:26.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:46:26.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.121+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:46:26.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:46:26.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.141+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:46:26.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.161+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:46:26.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:46:26.180742+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123452 2024-09-16T03:46:26.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:46:26.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 280 16 3594808 3594792 802.333 807.812 0.00113004 0.00123452 2024-09-16T03:46:26.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.189+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:46:26.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.197+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:26.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.201+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:26.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:46:26.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.213+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:26.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.229+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:46:26.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.229+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:26.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.237+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:46:26.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.245+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:26.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.269+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:46:26.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:26.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.297+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:46:26.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:26.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.317+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:46:26.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:46:26.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:46:26.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:26.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.357+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:46:26.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.393+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:46:26.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.409+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:46:26.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.421+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:46:26.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.429+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:46:26.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.441+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:46:26.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.441+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:46:26.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:46:26.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.481+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:26.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.489+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:46:26.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.513+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:26.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.517+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:26.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.537+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:26.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.541+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:26.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.561+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:46:26.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:26.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.573+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:46:26.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.577+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:46:26.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:46:26.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.593+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:46:26.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.617+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:46:26.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.625+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:26.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:26.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.637+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:26.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:26.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:46:26.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.681+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:46:26.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.685+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:46:26.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:26.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.717+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:46:26.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.733+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:26.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:46:26.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:46:26.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:46:26.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.789+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:46:26.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.805+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:46:26.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:46:26.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.829+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:46:26.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.845+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:46:26.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.857+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:26.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.889+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:46:26.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.893+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:46:26.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:46:26.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.909+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:46:26.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:46:26.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:26.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.953+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:46:26.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.965+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:26.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.973+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:46:26.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:26.989+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:46:27.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.009+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:27.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.009+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:46:27.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.017+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:27.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.033+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:46:27.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.033+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:46:27.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.049+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:27.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.069+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:27.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.073+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:46:27.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.085+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:46:27.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.089+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:27.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:27.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:27.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.121+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:46:27.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.133+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:46:27.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.137+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:46:27.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.153+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:46:27.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:46:27.179 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 281 16 3608012 3607996 802.415 825.25 0.000733045 0.00123439 2024-09-16T03:46:27.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.185+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:27.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.201+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:46:27.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.209+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:46:27.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.225+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:46:27.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.233+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:46:27.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:46:27.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.249+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:46:27.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.269+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:27.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.281+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:46:27.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.289+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:46:27.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.293+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:46:27.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.305+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:46:27.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.309+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:46:27.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.317+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:27.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.337+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:46:27.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.345+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:46:27.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.357+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:27.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.365+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:46:27.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.377+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:27.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.409+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:46:27.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.417+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:46:27.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.445+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:46:27.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.457+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:46:27.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.465+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:27.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.465+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:46:27.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.469+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:27.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.477+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:46:27.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.501+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:27.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.505+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:27.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.521+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:27.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.553+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:46:27.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:27.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.557+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:27.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.561+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:27.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.569+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:46:27.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.629+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:46:27.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.645+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:46:27.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.649+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:27.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.657+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:27.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.657+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:46:27.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.661+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:27.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.681+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:46:27.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.693+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:46:27.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.697+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:46:27.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.705+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:46:27.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:46:27.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.721+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:46:27.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.721+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:46:27.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:46:27.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.757+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:27.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:46:27.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.769+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:27.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.809+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:46:27.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:46:27.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.817+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:46:27.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.837+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:27.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.845+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:46:27.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.849+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:27.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.853+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:46:27.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.877+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:27.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.889+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:46:27.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.893+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:27.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.905+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:27.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.925+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:27.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:46:27.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.945+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:27.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.949+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:46:27.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.965+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:46:27.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.977+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:46:28.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:27.997+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:28.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:46:28.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.029+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:46:28.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.033+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:46:28.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.041+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:46:28.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.049+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:28.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.049+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:46:28.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.061+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:28.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.069+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:28.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:46:28.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:46:28.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:46:28.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.105+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:28.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.117+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:28.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.137+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:28.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.141+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:46:28.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:46:28.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:46:28.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.173+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:28.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 282 16 3621097 3621081 802.469 817.812 0.000903474 0.0012343 2024-09-16T03:46:28.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.181+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:28.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.185+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:28.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.201+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:46:28.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.209+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:28.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.229+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:28.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:28.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.249+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:46:28.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.253+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:46:28.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.281+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:28.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:46:28.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:46:28.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:46:28.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:46:28.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:46:28.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.333+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:46:28.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:28.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.365+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:28.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:46:28.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:46:28.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:28.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.413+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:28.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.421+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:28.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.425+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:46:28.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.429+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:28.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.461+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:46:28.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.477+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:46:28.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.477+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:46:28.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:46:28.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.509+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:46:28.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:46:28.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.517+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:46:28.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.541+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:46:28.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.549+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:46:28.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.553+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:28.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:46:28.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:46:28.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.593+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:46:28.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.625+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:46:28.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.633+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:46:28.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:46:28.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.657+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:28.673 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.669+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:46:28.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.673+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:28.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.677+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:46:28.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.697+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:28.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.697+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:46:28.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.705+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:46:28.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.741+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:28.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:46:28.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.749+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:46:28.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:46:28.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:28.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.781+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:46:28.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.789+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:46:28.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.817+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:28.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.821+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:28.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.833+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:46:28.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.837+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:46:28.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.861+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:28.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:46:28.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.893+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:46:28.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.913+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:28.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:28.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.917+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:46:28.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:28.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.953+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:28.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.969+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:46:28.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.981+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:46:28.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:28.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:46:29.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:46:29.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.009+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:46:29.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.021+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:46:29.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:46:29.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:29.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.045+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:46:29.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.089+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:46:29.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:29.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.113+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:29.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.113+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:46:29.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.117+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:29.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.141+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:46:29.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:46:29.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.153+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:46:29.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.157+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:29.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 283 16 3634245 3634229 802.537 821.75 0.000797899 0.0012342 2024-09-16T03:46:29.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:46:29.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.205+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:46:29.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.225+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:46:29.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.237+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:46:29.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.249+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:46:29.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:29.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:46:29.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.285+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:46:29.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.293+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:46:29.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.305+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:46:29.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.325+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:29.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.325+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:46:29.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.329+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:29.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.405+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:29.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.425+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:29.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.433+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:29.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:46:29.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.461+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:29.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.465+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:46:29.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.485+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:29.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.505+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:46:29.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.505+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:46:29.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.533+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:46:29.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:46:29.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.557+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:29.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.577+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:46:29.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.577+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:46:29.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.585+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:29.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:46:29.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.617+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:46:29.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.625+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:46:29.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.657+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:46:29.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:29.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.669+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:46:29.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.685+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:46:29.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.697+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:29.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.705+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:46:29.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.717+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:46:29.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.717+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:29.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.725+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:46:29.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:29.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.741+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:29.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.753+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:46:29.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.757+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:29.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:29.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.781+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:29.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.801+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:46:29.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.801+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:46:29.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:29.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.821+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:46:29.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.837+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:46:29.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.857+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:46:29.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:46:29.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.865+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:46:29.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.881+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:46:29.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.885+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:29.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.901+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:46:29.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.909+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:29.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.933+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:29.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:29.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.957+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:46:29.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.973+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:46:29.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:29.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.977+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:46:29.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:29.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:30.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.021+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:46:30.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.029+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:30.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.049+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:46:30.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.057+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:46:30.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.057+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:46:30.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.077+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:46:30.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.081+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:46:30.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.089+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:46:30.107 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.101+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:46:30.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.105+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:46:30.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.125+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:30.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.133+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:46:30.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.145+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:30.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.149+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:30.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:30.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:46:30.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.169+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:46:30.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 284 15 3646478 3646463 802.403 764.625 0.00052786 0.00123441 2024-09-16T03:46:30.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:30.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.193+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:46:30.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.213+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:46:30.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:46:30.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.245+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:30.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.245+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:46:30.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.261+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:30.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.269+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:46:30.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.301+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:30.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:46:30.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.337+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:46:30.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.341+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:30.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.353+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:46:30.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.381+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:30.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.397+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:46:30.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:30.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.417+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:30.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.433+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:46:30.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:46:30.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:46:30.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.481+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:46:30.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.493+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:46:30.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:46:30.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.537+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:30.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.549+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:46:30.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.573+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:30.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.581+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:30.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:30.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:46:30.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.625+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:30.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.641+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:30.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.641+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:46:30.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.669+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:30.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:46:30.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:46:30.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.721+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:46:30.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975a1889:::benchmark_data_smithi138_27857_object3165:head, will try copies on 0,4 2024-09-16T03:46:30.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.757+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:30.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.765+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:46:30.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.769+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:30.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.769+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:46:30.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.793+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:30.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:30.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.829+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:46:30.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.845+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:46:30.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.849+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:46:30.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.865+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:46:30.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.881+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:30.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.881+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:46:30.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:30.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:46:30.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:46:30.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:30.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.961+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:46:30.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.985+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:46:30.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.989+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:30.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.993+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:46:30.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:30.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:31.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.013+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:31.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.029+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:46:31.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.037+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:46:31.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:31.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.069+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:46:31.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.081+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:31.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.093+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:46:31.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:31.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.105+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:31.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:46:31.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.109+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:31.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.137+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:46:31.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:31.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:46:31.172 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.169+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:46:31.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.169+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:46:31.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.173+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:46:31.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 285 16 3659693 3659677 802.485 825.875 0.000669764 0.00123428 2024-09-16T03:46:31.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.177+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:46:31.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.197+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:46:31.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.197+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:31.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.217+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:46:31.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.233+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:46:31.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.245+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:46:31.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.261+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:46:31.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.277+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:31.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.281+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:46:31.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.293+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:46:31.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.301+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:46:31.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.301+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:46:31.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.317+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:31.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.333+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:46:31.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:46:31.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.357+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:31.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.377+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:31.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.385+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:46:31.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.385+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:31.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.405+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:46:31.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.405+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:31.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:31.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.441+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:46:31.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.449+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:46:31.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.449+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:46:31.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.481+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:31.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.489+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:46:31.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.505+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:46:31.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.509+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:31.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.513+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:31.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.521+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:46:31.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.541+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:31.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.545+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:46:31.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.545+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:46:31.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.545+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:46:31.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.573+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:46:31.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.585+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:46:31.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:46:31.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.609+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:46:31.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.613+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:31.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.617+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:31.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:31.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.649+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:46:31.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.673+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:46:31.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.677+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:46:31.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.701+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:46:31.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.705+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:31.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:46:31.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.733+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:46:31.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.737+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:31.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.757+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:31.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.785+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:46:31.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.785+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:46:31.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:46:31.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.813+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:46:31.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.821+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:46:31.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.821+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:46:31.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.837+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:46:31.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.837+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:31.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.861+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:46:31.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:31.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.881+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:31.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.893+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:31.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.909+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:46:31.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.913+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:46:31.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.933+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:46:31.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.937+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:46:31.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:31.957+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:46:32.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.029+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:32.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.037+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:46:32.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.045+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:46:32.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.049+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:46:32.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.049+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:32.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.069+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:46:32.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.089+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:46:32.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.093+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:32.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:32.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:46:32.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.137+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:46:32.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:46:32.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.153+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:46:32.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:46:32.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.173+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:46:32.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 286 16 3672382 3672366 802.452 793.062 0.000830494 0.00123433 2024-09-16T03:46:32.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.181+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:46:32.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.181+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:46:32.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:32.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.229+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:46:32.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.265+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:46:32.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:46:32.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.277+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:46:32.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.281+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:46:32.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.285+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:32.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.305+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:32.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:46:32.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.337+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:32.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.341+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:46:32.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b92a4c:::benchmark_data_smithi138_27857_object1499:head, will try copies on 3,4 2024-09-16T03:46:32.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.349+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:32.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.361+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:46:32.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.369+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:46:32.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.397+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:32.408 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.401+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:32.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:46:32.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.425+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:46:32.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:46:32.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.473+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:32.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.489+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:32.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.513+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:46:32.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:46:32.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:46:32.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:46:32.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.525+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:46:32.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:32.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.581+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:46:32.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.589+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:46:32.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:46:32.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.605+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:32.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.621+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:46:32.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.621+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:46:32.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.649+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:32.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.669+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:46:32.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:46:32.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.689+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:46:32.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.689+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:46:32.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.721+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:46:32.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.725+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:46:32.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.725+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:32.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.745+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:32.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.761+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:46:32.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:32.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.777+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:32.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.785+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:46:32.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.805+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:32.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:46:32.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.817+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:46:32.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.821+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:32.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.825+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:46:32.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.833+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:46:32.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.837+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:46:32.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:46:32.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.869+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:32.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.889+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:46:32.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.889+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:46:32.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.905+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:46:32.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:32.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.913+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:32.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:32.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.937+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:46:32.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.941+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:46:32.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.949+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:46:33.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:32.997+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:46:33.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.009+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:46:33.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:46:33.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:33.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.057+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:33.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.061+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:46:33.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.069+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:33.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:33.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:33.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:46:33.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.133+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:33.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.137+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:46:33.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:46:33.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.169+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:46:33.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.169+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:33.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 287 16 3685438 3685422 802.499 816 0.000525133 0.00123425 2024-09-16T03:46:33.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:46:33.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.185+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:46:33.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.193+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:46:33.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:33.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.225+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:33.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:46:33.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.273+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:46:33.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.293+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:46:33.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.293+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:33.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:46:33.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.329+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:33.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.337+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:46:33.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.341+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:33.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.349+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:33.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.361+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:46:33.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.365+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:46:33.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.385+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:33.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.385+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:46:33.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.409+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:46:33.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.413+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:33.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:33.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.441+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:46:33.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.457+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:46:33.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.461+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:46:33.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.481+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:46:33.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.489+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:33.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:46:33.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:46:33.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.537+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:33.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.537+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:46:33.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.541+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:33.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:33.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.557+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:33.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:33.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:33.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.577+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:46:33.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.585+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:46:33.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:46:33.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.625+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:46:33.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.641+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:46:33.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.645+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:46:33.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.661+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:33.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.677+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:46:33.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.685+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:46:33.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.693+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:46:33.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.709+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:33.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:46:33.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.721+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:46:33.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.725+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:46:33.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.745+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:33.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:46:33.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.749+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:46:33.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.765+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:46:33.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.777+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:46:33.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.781+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:33.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.785+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:46:33.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.793+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:33.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.825+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:46:33.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:46:33.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.845+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:46:33.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.865+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:33.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:46:33.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.885+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:46:33.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:33.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.913+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:46:33.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.925+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:33.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.953+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:46:33.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:46:33.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.977+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:46:33.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:46:33.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:33.993+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:46:34.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:46:34.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:34.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.021+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:34.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:46:34.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.053+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:46:34.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.053+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:34.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.065+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:46:34.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.065+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:46:34.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:34.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.073+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:34.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:46:34.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.101+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:46:34.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.109+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:46:34.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.113+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:34.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.113+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:46:34.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 288 15 3698281 3698266 802.5 802.75 0.000795611 0.00123426 2024-09-16T03:46:34.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:46:34.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.185+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:34.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.197+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:34.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.205+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:34.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.209+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:46:34.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.217+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:46:34.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.225+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:46:34.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.229+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:46:34.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:46:34.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.269+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:34.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.273+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:46:34.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.289+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:46:34.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.297+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:46:34.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.365+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:46:34.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.369+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:34.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.381+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:34.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.405+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:46:34.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.413+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:46:34.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.421+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:34.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.421+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:46:34.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.465+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:46:34.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:34.500 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.493+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:34.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.517+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:46:34.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:34.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.533+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:34.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:46:34.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.537+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:46:34.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:46:34.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.553+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:46:34.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:46:34.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:46:34.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.597+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:34.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:46:34.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:34.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.613+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:46:34.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:46:34.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:46:34.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.661+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:46:34.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.669+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:34.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.681+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:34.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.689+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:34.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.701+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:46:34.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.701+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:46:34.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.705+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:34.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.733+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:46:34.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.741+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:46:34.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:34.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.749+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:34.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:46:34.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:46:34.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:46:34.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.785+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:46:34.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:46:34.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.801+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:34.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.813+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:46:34.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.825+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:46:34.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.829+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:34.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.845+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:46:34.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:34.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:46:34.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.849+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:34.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:46:34.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.905+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:46:34.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.909+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:34.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.921+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:34.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.929+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:34.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.941+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:46:34.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.941+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:46:34.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.949+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:34.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.973+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:34.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:34.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:46:35.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.001+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:46:35.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:35.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.033+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:46:35.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:46:35.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.041+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:35.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.065+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:35.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.069+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:46:35.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:46:35.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.093+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:46:35.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.105+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:46:35.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.117+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:46:35.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.125+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:46:35.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.137+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:46:35.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:35.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.153+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:35.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 289 15 3710199 3710184 802.3 744.875 0.000918601 0.00123456 2024-09-16T03:46:35.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.181+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:46:35.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.193+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:35.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:46:35.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:46:35.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:46:35.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.253+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:46:35.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.281+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:35.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.293+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:46:35.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:46:35.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.297+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:35.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.317+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:35.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.317+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:46:35.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.321+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:46:35.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.341+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:46:35.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.377+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:35.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:35.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.405+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:46:35.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.413+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:46:35.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.417+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:46:35.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.445+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:35.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:46:35.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.465+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:46:35.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.481+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:35.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:46:35.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:35.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.541+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:35.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:35.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.581+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:46:35.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.625+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:46:35.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.637+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:46:35.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:46:35.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.657+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:46:35.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.665+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:46:35.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.681+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:46:35.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:46:35.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.693+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:35.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.701+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:46:35.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.721+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:46:35.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.729+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:35.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.729+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:46:35.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.741+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:46:35.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.761+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:46:35.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.773+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:35.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.785+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:46:35.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:46:35.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.801+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:46:35.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.825+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:46:35.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.841+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:35.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.853+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:35.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.853+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:46:35.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:46:35.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:46:35.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.909+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:35.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.917+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:35.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.921+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:46:35.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.929+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:35.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.945+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:35.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.949+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:46:35.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:46:35.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.973+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:46:35.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.977+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:35.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:35.989+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:46:36.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.001+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:46:36.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.005+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:46:36.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.025+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:36.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.025+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:36.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.045+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:46:36.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.057+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:36.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.065+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:36.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:46:36.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.101+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:46:36.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.109+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:46:36.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.121+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:46:36.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.121+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ee061:::benchmark_data_smithi138_27857_object692:head, will try copies on 3,4 2024-09-16T03:46:36.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.133+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:46:36.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.161+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:36.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 290 16 3723339 3723323 802.365 821.188 0.000814537 0.00123447 2024-09-16T03:46:36.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:36.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:46:36.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.209+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:36.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.209+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:36.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.217+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:36.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.241+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:46:36.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:46:36.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.257+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:36.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.261+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:46:36.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.293+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:46:36.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.297+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:46:36.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:46:36.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.329+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:36.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.353+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:46:36.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.357+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:46:36.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.357+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:36.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.373+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:46:36.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.377+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:36.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:46:36.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.401+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:36.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.445+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:46:36.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:46:36.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.453+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:36.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:46:36.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:46:36.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:46:36.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.489+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:36.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.489+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:46:36.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.509+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:36.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.525+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:46:36.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.557+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:46:36.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.565+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:36.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.581+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:36.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.593+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:36.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:46:36.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea52171:::benchmark_data_smithi138_27857_object823:head, will try copies on 0,4 2024-09-16T03:46:36.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.621+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:36.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.633+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:46:36.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.649+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:36.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.657+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:36.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.673+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:36.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.677+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:46:36.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.681+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:46:36.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.689+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:46:36.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:46:36.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:46:36.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.725+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:46:36.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.733+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:36.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.737+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:36.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.741+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:46:36.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.769+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:46:36.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:36.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.781+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:46:36.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.797+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:36.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.809+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:46:36.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.813+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:46:36.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:36.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.829+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:36.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.841+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:46:36.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:46:36.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:46:36.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.861+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:46:36.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.897+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:46:36.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.897+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:46:36.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.901+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:36.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.909+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:36.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:46:36.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.941+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:46:36.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:46:36.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.981+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:46:37.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:36.997+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:37.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.017+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:37.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.025+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:46:37.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.037+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:37.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:46:37.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.057+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:46:37.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.057+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:46:37.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.077+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:46:37.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.077+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:46:37.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.121+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:37.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.129+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:46:37.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.157+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:46:37.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:46:37.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:37.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 291 16 3736220 3736204 802.374 805.062 0.000869841 0.00123446 2024-09-16T03:46:37.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.197+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:46:37.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.197+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:37.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.217+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:46:37.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.221+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:46:37.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.225+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:46:37.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.225+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:46:37.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.233+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:46:37.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.249+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:46:37.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:37.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.269+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:46:37.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.273+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:46:37.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.277+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:46:37.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.285+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:37.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.309+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:46:37.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.313+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:37.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.321+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:46:37.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.337+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:37.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.341+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:46:37.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.369+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:46:37.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.389+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:46:37.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.393+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:46:37.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:37.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.425+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:46:37.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.429+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:46:37.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.437+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:46:37.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.449+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:37.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:46:37.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:46:37.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.473+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:46:37.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.485+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:46:37.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.485+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:37.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.501+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:37.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:46:37.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.541+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:46:37.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.573+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:46:37.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.577+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:46:37.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.581+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:46:37.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.621+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:46:37.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.625+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:46:37.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.625+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:46:37.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.641+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:46:37.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.669+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:37.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.673+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:46:37.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.677+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:46:37.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:37.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.689+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:46:37.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.709+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:46:37.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.725+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:46:37.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.745+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:46:37.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:46:37.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:46:37.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.769+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:37.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:46:37.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.777+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:46:37.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.797+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:37.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.829+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:46:37.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.833+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:46:37.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.849+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:46:37.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:37.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:46:37.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.881+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:46:37.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.893+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:46:37.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.921+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:46:37.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:37.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.945+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:46:37.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.949+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:46:37.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:46:37.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.985+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:37.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:37.985+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:46:38.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.001+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:46:38.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.009+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:38.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.013+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:38.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.033+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:38.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.041+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:38.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.041+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:38.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.061+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:46:38.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.065+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:38.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.077+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:46:38.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.081+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:38.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.089+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:38.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.105+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:46:38.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.125+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:46:38.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:38.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.141+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:38.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:46:38.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:46:38.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.157+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:46:38.180 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 292 15 3749248 3749233 802.414 814.312 0.00114113 0.00123439 2024-09-16T03:46:38.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:46:38.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:38.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:46:38.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.213+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:46:38.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.221+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:46:38.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.229+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:46:38.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:46:38.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.277+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:46:38.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.289+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:46:38.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.305+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:38.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.305+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:46:38.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.325+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:46:38.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.333+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:46:38.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.337+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:46:38.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.345+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:46:38.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.357+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d173099:::benchmark_data_smithi138_27857_object1097:head, will try copies on 3,4 2024-09-16T03:46:38.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:46:38.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.401+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:46:38.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:46:38.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.421+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:46:38.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.429+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:46:38.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:46:38.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.449+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:46:38.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:38.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.477+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:46:38.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.497+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:46:38.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:38.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:46:38.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.557+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:38.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.561+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:46:38.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.565+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:46:38.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.589+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:46:38.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:38.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:46:38.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.621+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:38.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.637+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:38.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.637+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:46:38.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.637+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:46:38.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:46:38.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.661+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:46:38.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.693+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:46:38.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.697+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:38.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.721+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:46:38.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:46:38.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:46:38.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.753+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:46:38.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:38.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.805+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:38.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:46:38.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:46:38.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.837+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:46:38.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:38.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:46:38.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:38.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.877+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:46:38.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:46:38.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:46:38.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.925+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:38.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.933+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:46:38.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.953+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:46:38.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.969+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:46:38.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.973+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:46:38.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:46:38.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:38.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:46:39.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.005+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:46:39.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:46:39.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:46:39.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.025+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:46:39.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.033+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:46:39.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.041+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:46:39.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:39.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.061+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:46:39.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.069+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:46:39.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.073+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:46:39.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.093+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:46:39.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:46:39.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:39.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.125+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:46:39.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.149+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:46:39.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.165+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:39.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.165+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:46:39.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.169+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:46:39.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 293 16 3762597 3762581 802.523 834.25 0.000771955 0.00123422 2024-09-16T03:46:39.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:46:39.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.197+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:46:39.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.201+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:46:39.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.229+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:46:39.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.237+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:46:39.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.241+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:46:39.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:46:39.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.261+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:46:39.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.269+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:39.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.285+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:39.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.301+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:46:39.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.313+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:46:39.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.317+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:46:39.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.317+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:39.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.401+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:46:39.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.445+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:46:39.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.477+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:39.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.501+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:46:39.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.505+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:46:39.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.521+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:39.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:46:39.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:46:39.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:46:39.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.589+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:46:39.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.593+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:39.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.613+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:39.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.625+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:46:39.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.629+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:46:39.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.629+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:39.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.669+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:39.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:46:39.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.689+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:46:39.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.701+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:46:39.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.709+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:39.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.717+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:46:39.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.725+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:46:39.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.733+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:39.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.761+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:46:39.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:46:39.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.793+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:46:39.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.801+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:46:39.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.809+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:46:39.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.837+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:39.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.841+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:39.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:46:39.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.861+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:46:39.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.861+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:46:39.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:46:39.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.893+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:46:39.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.941+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:46:39.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.957+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:46:39.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.965+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:46:39.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.965+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:39.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.969+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:46:39.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:46:39.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:39.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:40.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:46:40.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:46:40.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:46:40.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.025+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:46:40.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.053+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:46:40.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.057+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:40.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.057+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:46:40.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.113+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:46:40.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.113+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:46:40.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.125+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:40.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.133+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:40.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.141+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:46:40.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:46:40.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:40.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 294 16 3774170 3774154 802.253 723.312 0.000780481 0.00123464 2024-09-16T03:46:40.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.185+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:46:40.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.185+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:46:40.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.189+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:46:40.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:46:40.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.229+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:46:40.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:46:40.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:46:40.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.257+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:46:40.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:46:40.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.297+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:46:40.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.313+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:46:40.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.313+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:40.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.317+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:40.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:40.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.337+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:46:40.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:40.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.377+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:40.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.389+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:40.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.397+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:40.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.417+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6eeecd:::benchmark_data_smithi138_27857_object571:head, will try copies on 0,4 2024-09-16T03:46:40.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:46:40.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.445+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:46:40.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.453+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:46:40.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.465+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:46:40.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.485+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:46:40.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.485+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:46:40.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.497+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:46:40.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.525+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:40.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.533+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:46:40.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.549+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:46:40.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:46:40.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:46:40.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:46:40.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:40.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.589+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:46:40.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.593+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:40.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.601+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:46:40.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:46:40.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.641+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:46:40.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.641+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:40.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:46:40.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.669+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:46:40.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.693+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:46:40.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.693+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:46:40.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:46:40.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.701+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:46:40.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:46:40.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.713+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:46:40.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.725+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:46:40.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.753+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:46:40.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:46:40.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.785+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:40.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.789+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:46:40.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.797+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:46:40.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.845+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:40.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:40.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.853+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:46:40.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.857+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:40.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.877+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:46:40.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.885+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:46:40.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.893+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:46:40.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.917+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:46:40.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:46:40.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:46:40.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.937+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:46:40.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.941+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:46:40.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.961+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:46:40.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:46:40.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.973+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:40.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.981+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:40.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:46:41.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:40.997+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:46:41.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.001+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:46:41.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.017+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:46:41.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.061+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:41.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:46:41.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:46:41.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.101+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:46:41.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.101+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:41.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.125+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:46:41.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.129+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:46:41.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:46:41.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.153+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:41.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 295 16 3787046 3787030 802.261 804.75 0.0012914 0.00123464 2024-09-16T03:46:41.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.177+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:46:41.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.177+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:46:41.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.193+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:41.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.193+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:41.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.209+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:46:41.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.233+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:46:41.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.233+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:41.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.241+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:46:41.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.265+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:46:41.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.269+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:46:41.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.289+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:46:41.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.293+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6aa611:::benchmark_data_smithi138_27857_object2481:head, will try copies on 3,4 2024-09-16T03:46:41.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:46:41.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:46:41.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.345+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:46:41.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.353+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:41.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.353+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:46:41.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:46:41.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:46:41.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.393+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:46:41.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.409+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:46:41.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.421+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:46:41.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.437+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:41.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.441+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:46:41.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.445+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7157695:::benchmark_data_smithi138_27857_object3198:head, will try copies on 2,3 2024-09-16T03:46:41.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.461+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:46:41.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.493+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:46:41.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:46:41.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.513+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:46:41.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.517+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:41.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.525+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:46:41.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.529+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:46:41.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.545+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:46:41.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:46:41.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.577+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:41.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.581+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:46:41.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:46:41.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.609+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:46:41.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.613+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:46:41.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.637+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:41.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a75bd40:::benchmark_data_smithi138_27857_object2809:head, will try copies on 3,4 2024-09-16T03:46:41.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.677+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:46:41.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.685+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:46:41.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:41.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.697+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:46:41.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:46:41.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.737+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:41.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.741+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:41.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.749+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:46:41.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.749+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:46:41.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.757+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:46:41.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.773+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:41.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.777+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:46:41.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:46:41.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.813+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:46:41.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.825+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:46:41.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.825+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:46:41.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.833+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:46:41.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.857+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:46:41.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.869+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:41.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.893+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:46:41.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:46:41.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:46:41.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.973+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:46:41.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:41.989+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:46:42.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be9acf8b:::benchmark_data_smithi138_27857_object563:head, will try copies on 2,3 2024-09-16T03:46:42.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.009+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:42.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.033+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:46:42.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.033+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:46:42.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.057+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:42.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.065+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:46:42.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.081+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:42.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:46:42.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.085+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948ed0fa:::benchmark_data_smithi138_27857_object2753:head, will try copies on 0,4 2024-09-16T03:46:42.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.137+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:46:42.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.157+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:42.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.157+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:42.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:42.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.173+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:46:42.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 296 16 3800365 3800349 802.363 832.438 0.00337577 0.00123447 2024-09-16T03:46:42.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:42.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:46:42.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:42.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.201+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:42.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.217+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:46:42.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.221+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98375d97:::benchmark_data_smithi138_27857_object2981:head, will try copies on 0,4 2024-09-16T03:46:42.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.249+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:46:42.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:46:42.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.257+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:46:42.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.277+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:42.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.293+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:46:42.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.305+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:46:42.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:46:42.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:46:42.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:46:42.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.361+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:46:42.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.373+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:46:42.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:42.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:42.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.393+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:46:42.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:46:42.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.401+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:46:42.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.405+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:42.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.437+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:42.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.445+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:46:42.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.445+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:46:42.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.449+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:46:42.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.453+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:46:42.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.497+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:42.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.501+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:42.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:46:42.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.521+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:46:42.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:42.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.549+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:46:42.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.565+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:42.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.565+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:46:42.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.577+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:42.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.577+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:46:42.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.597+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:46:42.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:42.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.621+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:46:42.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.649+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:42.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.665+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:42.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.681+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:46:42.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.689+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:46:42.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:46:42.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.709+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:46:42.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.721+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:46:42.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.733+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:42.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.741+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:46:42.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.749+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:42.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.769+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:42.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.781+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:42.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.789+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:42.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.793+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:46:42.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.805+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:42.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.809+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:46:42.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.817+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:42.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.833+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:42.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.833+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:42.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:46:42.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:42.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:46:42.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:42.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:46:42.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.885+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:46:42.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.901+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:42.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.905+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:46:42.938 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.933+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:42.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.949+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:42.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.953+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:46:42.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.961+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:46:42.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.973+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:42.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:42.981+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:46:43.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.005+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:43.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.009+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:46:43.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:46:43.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.025+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:43.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.037+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:46:43.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.037+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:46:43.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.057+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:46:43.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.057+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:43.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.089+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:43.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.097+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:46:43.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.105+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:46:43.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.125+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:46:43.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.129+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:46:43.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.133+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:46:43.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:46:43.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:46:43.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:43.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.169+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:46:43.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.169+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:46:43.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 297 16 3812942 3812926 802.308 786.062 0.000626666 0.00123455 2024-09-16T03:46:43.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:46:43.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:46:43.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:43.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.225+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:43.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.245+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:43.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.261+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:46:43.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.281+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:46:43.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.285+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:43.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.309+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:46:43.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:46:43.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.325+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:43.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.365+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:46:43.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:46:43.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.385+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:46:43.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.389+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:46:43.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.393+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:46:43.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:46:43.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:43.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:46:43.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.417+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:43.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.453+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:43.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.465+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:43.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.469+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:46:43.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:43.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.493+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:43.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.497+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:46:43.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:46:43.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:43.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:43.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.549+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:43.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.557+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:46:43.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.569+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:46:43.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.585+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:46:43.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.593+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:43.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.597+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d30eb1:::benchmark_data_smithi138_27857_object1334:head, will try copies on 2,3 2024-09-16T03:46:43.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:46:43.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:46:43.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd8c875:::benchmark_data_smithi138_27857_object579:head, will try copies on 0,4 2024-09-16T03:46:43.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.633+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:46:43.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.645+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:46:43.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.665+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:46:43.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:43.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.685+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:46:43.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:46:43.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.709+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:43.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.729+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:46:43.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.733+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:46:43.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.737+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:43.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.737+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:46:43.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.761+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:43.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.769+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:46:43.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:43.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.777+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c2c7dd:::benchmark_data_smithi138_27857_object761:head, will try copies on 0,4 2024-09-16T03:46:43.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.781+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:46:43.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.797+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:46:43.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.813+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:43.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.841+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ab95f7:::benchmark_data_smithi138_27857_object3254:head, will try copies on 2,3 2024-09-16T03:46:43.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:46:43.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.873+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:46:43.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:46:43.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.889+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:46:43.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.893+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:43.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.905+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:46:43.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.921+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:46:43.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.937+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:46:43.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.941+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:46:43.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:43.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.961+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:46:43.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.977+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:46:43.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:43.985+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:46:44.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.001+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:44.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.005+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:46:44.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:46:44.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.017+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:46:44.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.025+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:46:44.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.065+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:44.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.069+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:46:44.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.085+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:44.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.101+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:46:44.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:44.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:46:44.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:44.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.129+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:46:44.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.141+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:44.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.141+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:46:44.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.153+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:44.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.157+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:44.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 298 15 3825578 3825563 802.266 789.812 0.000898694 0.00123462 2024-09-16T03:46:44.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:44.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.217+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:46:44.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.225+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:44.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.229+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:46:44.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:46:44.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.261+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:44.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.281+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:46:44.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.293+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:46:44.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:46:44.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.317+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:44.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.321+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:44.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.325+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:44.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.341+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:46:44.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:46:44.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.357+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:46:44.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.377+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:46:44.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.377+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:46:44.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.389+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:46:44.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.409+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:44.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.429+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:46:44.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.437+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:46:44.452 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.449+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:46:44.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.457+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:46:44.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:46:44.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:46:44.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.501+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:46:44.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.505+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:46:44.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.509+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:46:44.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.509+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:46:44.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.513+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:46:44.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:46:44.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:46:44.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.577+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:46:44.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:46:44.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.601+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:46:44.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.601+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:46:44.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.609+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:46:44.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.625+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:46:44.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.637+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:44.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.641+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:46:44.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.641+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:46:44.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.661+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:46:44.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:44.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.673+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:46:44.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.677+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:46:44.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:44.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.741+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:46:44.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.753+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:46:44.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.765+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:46:44.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.781+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:46:44.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.781+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:46:44.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:46:44.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:46:44.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.817+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:46:44.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.833+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:46:44.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.845+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:46:44.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:46:44.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.861+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:46:44.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.861+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:46:44.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.869+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:46:44.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.889+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:44.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:46:44.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.905+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:46:44.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.909+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:44.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.929+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:46:44.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:46:44.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:46:44.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:44.989+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:45.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.013+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:46:45.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.013+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:46:45.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:46:45.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:45.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.061+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:46:45.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:46:45.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.081+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:46:45.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.097+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:45.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.113+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:46:45.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:46:45.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.133+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:46:45.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.141+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:46:45.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.153+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:45.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:46:45.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.169+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:46:45.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 299 16 3838583 3838567 802.301 812.75 0.00060343 0.00123457 2024-09-16T03:46:45.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.193+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:46:45.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:46:45.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.217+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:46:45.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.257+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:46:45.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:46:45.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.273+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:46:45.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.281+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:46:45.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.293+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:45.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:46:45.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:45.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.313+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:46:45.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.321+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:46:45.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.329+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:46:45.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.361+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:45.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.361+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:46:45.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.385+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:45.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:46:45.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.405+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:46:45.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.413+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:46:45.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.425+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:46:45.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.429+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:46:45.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:46:45.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:45.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.461+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:46:45.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:46:45.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.485+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:46:45.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.497+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:45.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.501+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:46:45.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.509+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:46:45.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:46:45.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.545+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:45.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:46:45.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.581+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:46:45.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.593+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:46:45.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.605+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:46:45.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.605+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:46:45.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.613+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:46:45.631 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.625+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:46:45.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.633+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:46:45.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.645+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:45.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.653+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:46:45.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.657+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:45.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.673+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:45.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.681+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:46:45.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:46:45.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.689+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:46:45.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.705+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:46:45.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.713+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:46:45.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.713+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:46:45.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.733+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:46:45.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.745+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7e06ec:::benchmark_data_smithi138_27857_object703:head, will try copies on 3,4 2024-09-16T03:46:45.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.761+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:45.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.765+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:46:45.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:46:45.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.793+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:45.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.809+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:45.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.821+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:46:45.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.825+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:46:45.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:45.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.845+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:45.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.877+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:46:45.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.881+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:46:45.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.885+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bc5b18:::benchmark_data_smithi138_27857_object2651:head, will try copies on 3,4 2024-09-16T03:46:45.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.897+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:46:45.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:46:45.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.921+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:46:45.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:45.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.945+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:46:45.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.949+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:46:45.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.977+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:45.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.981+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:46:45.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:45.985+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:46:46.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.013+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:46.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.017+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:46:46.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.017+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:46:46.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:46:46.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.049+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:46:46.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.057+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:46:46.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.069+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:46:46.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:46:46.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:46.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.117+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:46:46.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.117+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:46:46.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:46:46.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.145+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:46:46.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:46:46.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.149+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:46:46.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:46:46.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.173+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:46.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:46:46.182541+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123466 2024-09-16T03:46:46.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:46:46.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 300 16 3851122 3851106 802.238 783.688 0.00175928 0.00123466 2024-09-16T03:46:46.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.193+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:46:46.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.201+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:46:46.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.213+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:46:46.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.241+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:46.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.241+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:46:46.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.241+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:46:46.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.281+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:46:46.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.301+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:46:46.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.301+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:46.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.321+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:46:46.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.325+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:46:46.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.337+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:46:46.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.341+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:46:46.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.341+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:46:46.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.353+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:46:46.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.365+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:46:46.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.365+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:46:46.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:46:46.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:46.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.389+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:46.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.421+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:46.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.429+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:46.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.433+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:46:46.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.445+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:46.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:46.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.457+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:46:46.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.477+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:46:46.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.481+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:46:46.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.501+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:46:46.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.501+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:46:46.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.537+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:46:46.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.541+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:46:46.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.557+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:46:46.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.565+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:46.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.573+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:46.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:46:46.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.577+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:46:46.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.589+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:46:46.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.593+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:46.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.613+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:46:46.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:46:46.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.629+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:46:46.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.637+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:46.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.641+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:46:46.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:46.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.697+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:46:46.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.721+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:46.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.725+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:46:46.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.733+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:46.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.737+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:46:46.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.741+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:46:46.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.761+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:46:46.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.769+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:46:46.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.777+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:46:46.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.793+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:46:46.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.801+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:46:46.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.801+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:46:46.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6143154c:::benchmark_data_smithi138_27857_object3135:head, will try copies on 3,4 2024-09-16T03:46:46.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.813+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:46:46.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:46:46.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.869+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:46:46.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.869+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:46:46.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.885+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:46:46.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.893+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:46:46.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.893+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:46:46.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.905+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:46:46.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.909+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:46:46.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:46:46.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.929+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:46:46.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:46:46.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.949+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:46:46.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.957+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:46:46.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:46.973+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:47.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.009+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:46:47.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.065+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:46:47.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.073+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:46:47.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.077+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:46:47.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.081+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:46:47.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.085+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:46:47.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.093+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:46:47.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.109+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541fecdf:::benchmark_data_smithi138_27857_object2219:head, will try copies on 3,4 2024-09-16T03:46:47.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.129+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:47.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.133+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:46:47.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.141+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:46:47.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:46:47.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.173+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:46:47.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 301 16 3864008 3863992 802.249 805.375 0.000588794 0.00123465 2024-09-16T03:46:47.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:46:47.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:46:47.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.205+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:46:47.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.213+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:46:47.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:46:47.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.249+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:47.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.253+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:46:47.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.257+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:46:47.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:47.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.289+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:46:47.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.301+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:46:47.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:47.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.321+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:46:47.334 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.329+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:47.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.349+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:46:47.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:46:47.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.369+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:47.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:46:47.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.385+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:46:47.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.389+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:46:47.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.393+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:46:47.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.409+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:46:47.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.417+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:46:47.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.417+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:46:47.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.437+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:46:47.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.437+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:46:47.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.445+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:47.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:46:47.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.469+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:47.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.469+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:47.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.477+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:46:47.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.485+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:47.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.489+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:47.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.493+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:46:47.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.513+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:47.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.529+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:47.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.533+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:46:47.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:46:47.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.573+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:46:47.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.573+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:47.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.589+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:46:47.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.609+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:47.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.617+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:47.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.621+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bae14ee8:::benchmark_data_smithi138_27857_object3388:head, will try copies on 2,3 2024-09-16T03:46:47.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.633+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:46:47.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.637+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:46:47.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.653+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:46:47.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.669+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:47.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.681+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:46:47.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:46:47.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.697+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:46:47.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.709+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:46:47.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:46:47.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.745+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:46:47.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.749+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:46:47.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.753+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:46:47.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.753+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:47.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.793+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:46:47.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.793+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:46:47.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.797+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:46:47.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.813+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:46:47.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.825+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:47.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.845+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:46:47.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:46:47.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:46:47.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.881+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253fd27c:::benchmark_data_smithi138_27857_object3439:head, will try copies on 0,4 2024-09-16T03:46:47.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:46:47.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.901+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:46:47.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.905+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:46:47.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.905+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:46:47.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.917+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:47.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.921+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:46:47.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:46:47.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.929+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:47.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:46:47.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.949+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:46:47.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.969+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:46:47.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.993+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:46:47.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:46:48.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:47.997+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:46:48.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.005+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:46:48.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.025+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:48.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:46:48.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.045+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:46:48.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.069+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:46:48.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.073+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:46:48.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.089+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:48.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.097+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:46:48.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.101+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:48.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.109+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:46:48.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.117+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:46:48.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.141+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:48.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.145+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:48.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:46:48.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.161+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:46:48.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:46:48.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 302 16 3876458 3876442 802.169 778.125 0.000627643 0.00123477 2024-09-16T03:46:48.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:46:48.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.189+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:46:48.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.213+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:48.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.221+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:46:48.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.221+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:46:48.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.237+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:48.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.257+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:48.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.273+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:46:48.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:48.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.289+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:46:48.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:46:48.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.329+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:46:48.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.329+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:46:48.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:46:48.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.353+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:46:48.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.357+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:48.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.389+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:48.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:46:48.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.393+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:46:48.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.413+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:48.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.413+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:46:48.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.417+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:48.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:46:48.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.453+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:46:48.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.453+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:46:48.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.469+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:46:48.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:46:48.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.501+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:46:48.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:46:48.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:46:48.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.525+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:46:48.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:46:48.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.549+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:48.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.553+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:46:48.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.557+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:46:48.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.593+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:46:48.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.601+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:46:48.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.609+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:46:48.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.609+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:46:48.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.621+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:46:48.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.633+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:46:48.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.633+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:46:48.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.649+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:46:48.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.665+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:48.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.673+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:46:48.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.677+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:48.695 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:46:48.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:48.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.721+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:46:48.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:46:48.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.741+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:48.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.745+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:48.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.753+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:46:48.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:46:48.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.769+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:48.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.773+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:48.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.785+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:48.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.797+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:46:48.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:46:48.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.821+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:46:48.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.833+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:48.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.833+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:46:48.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.837+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:46:48.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:46:48.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.857+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:46:48.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.869+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:46:48.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:46:48.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.889+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:46:48.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.905+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:46:48.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.913+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:46:48.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.913+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:46:48.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.921+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:46:48.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e304f2:::benchmark_data_smithi138_27857_object2437:head, will try copies on 3,4 2024-09-16T03:46:48.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.937+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:48.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.941+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:48.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:48.969+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:46:49.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.005+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:49.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.013+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:46:49.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.013+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:49.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.017+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:49.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:46:49.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.037+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:49.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.053+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:46:49.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.073+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:46:49.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.093+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:46:49.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.113+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:49.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.129+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:49.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.153+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:49.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:46:49.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:49.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.161+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:46:49.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.165+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:49.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.173+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6163a684:::benchmark_data_smithi138_27857_object1062:head, will try copies on 3,4 2024-09-16T03:46:49.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 303 16 3889111 3889095 802.131 790.812 0.000543844 0.00123483 2024-09-16T03:46:49.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.213+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:46:49.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.213+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:46:49.234 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.229+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:46:49.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:49.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:49.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:46:49.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.277+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:46:49.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.277+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:46:49.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.281+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:46:49.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:49.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.285+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:46:49.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.301+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:46:49.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:46:49.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.337+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:49.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.345+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:46:49.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.365+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:46:49.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.377+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:49.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.389+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:46:49.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:49.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.489+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:46:49.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.497+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:46:49.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.497+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:46:49.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:46:49.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.541+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:49.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.557+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:46:49.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.561+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:46:49.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.561+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:46:49.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.569+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:46:49.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:49.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.601+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:46:49.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.609+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:49.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.633+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:46:49.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.637+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:46:49.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.649+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:46:49.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.653+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:49.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.677+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:49.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.681+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cdcd6ca:::benchmark_data_smithi138_27857_object3076:head, will try copies on 0,4 2024-09-16T03:46:49.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.693+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:46:49.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.701+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:46:49.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.705+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:46:49.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.713+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:49.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:46:49.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.737+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:46:49.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.813+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:49.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.821+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:46:49.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.825+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:46:49.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.841+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:49.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:46:49.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.857+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:46:49.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.865+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:46:49.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.869+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:46:49.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.877+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:46:49.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:46:49.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.893+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:49.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.921+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:46:49.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.925+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:49.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.953+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:46:49.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:46:49.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.977+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:49.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.981+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:46:49.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:49.989+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:46:50.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.009+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:46:50.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.017+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:50.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.021+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:46:50.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:50.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.025+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:50.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.041+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:46:50.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.041+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:46:50.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.077+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:46:50.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.081+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:50.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.097+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:50.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.105+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:50.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.113+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:46:50.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:50.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.137+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:46:50.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.141+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:46:50.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.149+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:46:50.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.157+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:46:50.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 304 16 3900840 3900824 801.903 733.062 0.0185484 0.00123518 2024-09-16T03:46:50.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.177+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:46:50.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.181+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e4dc106:::benchmark_data_smithi138_27857_object4124:head, will try copies on 0,4 2024-09-16T03:46:50.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.245+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:46:50.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.265+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:46:50.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:46:50.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.285+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:46:50.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.289+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:46:50.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.301+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:46:50.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.305+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:50.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.313+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:46:50.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.369+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:50.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.377+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:46:50.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.405+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:46:50.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.409+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:46:50.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.421+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:46:50.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.421+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:50.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.437+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:50.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.445+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:50.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:46:50.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.481+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:46:50.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.489+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:50.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.493+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:46:50.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.505+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:46:50.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.521+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:46:50.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.525+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:46:50.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.537+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:46:50.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.537+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:46:50.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.545+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:46:50.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:50.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.577+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:46:50.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.581+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:46:50.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.601+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:46:50.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.621+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:46:50.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.621+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:46:50.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.645+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:46:50.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:46:50.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:46:50.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.673+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:46:50.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.689+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:50.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.693+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:46:50.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.709+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:46:50.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.725+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:46:50.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:50.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.729+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:46:50.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.741+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:46:50.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.761+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:46:50.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:46:50.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.781+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:50.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.789+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:46:50.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:46:50.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.817+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd413a33:::benchmark_data_smithi138_27857_object1081:head, will try copies on 2,3 2024-09-16T03:46:50.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c133fae:::benchmark_data_smithi138_27857_object2765:head, will try copies on 0,4 2024-09-16T03:46:50.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.841+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:46:50.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.853+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:46:50.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:46:50.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.869+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:46:50.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:46:50.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.897+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512bd4a7:::benchmark_data_smithi138_27857_object3422:head, will try copies on 3,4 2024-09-16T03:46:50.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.913+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:46:50.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:46:50.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.921+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:46:50.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.929+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:50.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.949+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:46:50.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:46:50.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.977+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:46:50.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.981+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:46:51.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.997+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:46:51.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:50.997+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:46:51.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:46:51.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:46:51.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.065+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:46:51.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.065+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:46:51.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.077+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:46:51.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.081+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eef10e1:::benchmark_data_smithi138_27857_object323:head, will try copies on 3,4 2024-09-16T03:46:51.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.137+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:46:51.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.165+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:51.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 305 16 3913046 3913030 801.775 762.875 0.00105124 0.00123539 2024-09-16T03:46:51.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.181+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:46:51.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.193+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:46:51.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.201+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:46:51.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.205+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:46:51.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:46:51.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.285+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:46:51.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.313+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:46:51.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.325+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:46:51.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:46:51.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.337+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:46:51.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.349+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:46:51.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.361+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:46:51.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.381+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:46:51.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.385+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:46:51.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.389+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:46:51.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:46:51.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:51.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.425+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:46:51.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.437+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:46:51.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.445+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:46:51.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:51.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.457+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:46:51.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.457+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:46:51.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.477+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:46:51.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.489+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:51.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:46:51.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.529+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:46:51.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.537+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:46:51.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.545+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:46:51.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.553+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:46:51.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.569+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:46:51.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.589+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:46:51.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:46:51.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.601+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:51.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:51.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.617+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:46:51.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.629+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:51.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.641+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:51.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:46:51.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.653+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:46:51.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.661+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:46:51.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:51.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.693+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:46:51.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.701+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:51.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.705+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:46:51.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.737+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:46:51.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.741+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:51.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.749+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:46:51.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.757+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:46:51.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:46:51.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.777+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:46:51.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:46:51.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.817+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:46:51.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.829+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:46:51.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.829+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:46:51.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.857+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:46:51.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.861+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:46:51.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.869+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:46:51.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.893+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:51.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.897+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:46:51.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.905+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:46:51.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.909+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:46:51.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:46:51.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.941+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:46:51.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.965+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:46:51.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:51.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.973+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:46:51.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.981+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:46:51.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:51.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:52.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.005+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:52.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.013+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:46:52.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:46:52.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.041+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:46:52.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.053+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2fdb9f:::benchmark_data_smithi138_27857_object3503:head, will try copies on 0,4 2024-09-16T03:46:52.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.061+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:52.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.061+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:46:52.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.081+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:46:52.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.097+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:46:52.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:46:52.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:46:52.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.125+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:46:52.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:46:52.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.133+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:46:52.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.157+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:46:52.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.161+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:46:52.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.169+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:52.181 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 306 16 3926005 3925989 801.802 809.938 0.000892781 0.00123534 2024-09-16T03:46:52.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.181+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:46:52.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.189+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:46:52.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.217+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:46:52.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.233+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:46:52.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.265+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:52.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.273+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:46:52.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.293+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:46:52.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.317+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:52.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.333+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:46:52.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:46:52.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:52.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.357+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:46:52.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.377+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:52.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.389+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:46:52.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.389+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:52.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:46:52.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.409+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:52.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:46:52.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.425+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:46:52.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.425+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:46:52.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.445+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:46:52.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.449+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:46:52.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.461+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:46:52.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:52.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.493+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:46:52.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.497+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:52.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.501+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:46:52.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.529+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:46:52.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.549+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:46:52.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:46:52.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.561+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:46:52.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.569+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:46:52.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.573+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53addd30:::benchmark_data_smithi138_27857_object769:head, will try copies on 3,4 2024-09-16T03:46:52.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.597+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0e72ce:::benchmark_data_smithi138_27857_object3209:head, will try copies on 3,4 2024-09-16T03:46:52.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.597+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:46:52.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.601+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:52.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.605+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:46:52.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.637+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:46:52.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.641+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:46:52.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.657+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:46:52.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.665+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b90eb718:::benchmark_data_smithi138_27857_object3721:head, will try copies on 2,3 2024-09-16T03:46:52.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.665+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:46:52.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.669+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:46:52.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.689+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:46:52.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.697+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:46:52.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.713+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:46:52.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.717+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:46:52.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.721+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:52.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.737+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:46:52.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.749+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebbd242:::benchmark_data_smithi138_27857_object1531:head, will try copies on 0,4 2024-09-16T03:46:52.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:46:52.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.765+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:46:52.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.769+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:52.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.777+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:46:52.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.797+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:46:52.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.813+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:46:52.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:52.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.825+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:52.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.833+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:52.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.837+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:52.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.853+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:52.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.857+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:46:52.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:46:52.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.893+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:46:52.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.909+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:46:52.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:52.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:46:52.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:46:52.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:46:52.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.969+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:52.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:52.989+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:46:53.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.001+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:46:53.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.017+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:46:53.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.017+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:46:53.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:46:53.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.057+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:46:53.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.077+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:46:53.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.085+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:46:53.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.085+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:46:53.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.101+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:46:53.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.109+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:46:53.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.109+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:46:53.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.117+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:46:53.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.121+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:46:53.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.129+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:46:53.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.145+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09b59a8:::benchmark_data_smithi138_27857_object107:head, will try copies on 2,3 2024-09-16T03:46:53.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:46:53.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.157+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:46:53.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.173+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:46:53.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 307 16 3939080 3939064 801.852 817.188 0.000767457 0.00123526 2024-09-16T03:46:53.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.185+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:46:53.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.193+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:53.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.209+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:46:53.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.229+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:53.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.237+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:46:53.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.257+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:46:53.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:46:53.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:46:53.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:53.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:46:53.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.313+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:46:53.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.321+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:53.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.349+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f5c992:::benchmark_data_smithi138_27857_object4012:head, will try copies on 3,4 2024-09-16T03:46:53.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.377+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:46:53.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.385+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:46:53.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.389+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:46:53.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:53.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.405+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:46:53.423 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.417+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:46:53.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.421+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:53.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.421+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:46:53.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.441+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:46:53.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:46:53.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.449+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:46:53.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.469+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:46:53.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.489+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:46:53.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.509+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:46:53.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:53.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.545+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:46:53.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.557+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:46:53.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.577+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:46:53.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:46:53.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.585+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:46:53.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.589+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:46:53.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.609+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:46:53.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.641+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:46:53.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.645+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:46:53.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.657+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:46:53.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.661+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:46:53.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.673+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:46:53.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5606a8b0:::benchmark_data_smithi138_27857_object944:head, will try copies on 3,4 2024-09-16T03:46:53.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.701+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:46:53.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.713+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:46:53.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.717+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:46:53.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.725+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:46:53.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.753+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:46:53.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b8ba23f:::benchmark_data_smithi138_27857_object3580:head, will try copies on 0,4 2024-09-16T03:46:53.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.773+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:46:53.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.777+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:53.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.797+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:53.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.809+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:46:53.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.809+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:53.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:46:53.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.853+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:46:53.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.869+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0d8328:::benchmark_data_smithi138_27857_object2537:head, will try copies on 2,3 2024-09-16T03:46:53.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.885+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:46:53.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.885+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:53.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.889+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:46:53.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.897+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:46:53.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:46:53.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:46:53.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.941+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:46:53.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.953+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:53.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.973+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:46:53.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.985+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:46:54.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:53.997+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:46:54.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.013+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:54.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.025+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:46:54.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.033+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:46:54.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.041+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:46:54.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.057+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:46:54.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.061+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9034fb:::benchmark_data_smithi138_27857_object2280:head, will try copies on 3,4 2024-09-16T03:46:54.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.069+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:46:54.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:46:54.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.077+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:46:54.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.097+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:46:54.106 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:46:54.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.105+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:54.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.129+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:46:54.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:46:54.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.153+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:46:54.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.173+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:46:54.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 308 15 3952435 3952420 801.958 834.75 0.00221083 0.0012351 2024-09-16T03:46:54.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.189+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:46:54.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.201+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:46:54.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.205+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:46:54.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.217+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:46:54.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.217+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:46:54.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:46:54.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.241+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:46:54.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:54.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:46:54.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.273+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:54.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.293+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:54.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.293+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:46:54.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.305+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:54.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.317+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:46:54.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:46:54.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.333+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:54.358 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.353+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:46:54.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.357+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:46:54.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.377+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:46:54.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.401+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:46:54.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.425+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:46:54.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.433+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:46:54.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.437+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:46:54.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.445+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:46:54.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.445+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:46:54.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.457+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:46:54.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.477+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:46:54.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.485+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:46:54.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.501+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:46:54.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:46:54.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.521+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:46:54.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.529+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:46:54.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.545+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:46:54.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.549+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:54.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.569+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:54.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.577+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:46:54.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.585+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e9b80ba:::benchmark_data_smithi138_27857_object485:head, will try copies on 0,4 2024-09-16T03:46:54.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.589+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:54.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.593+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d135684:::benchmark_data_smithi138_27857_object416:head, will try copies on 3,4 2024-09-16T03:46:54.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.609+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:46:54.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.625+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:46:54.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.629+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:46:54.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:46:54.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.649+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:46:54.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:46:54.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:46:54.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.673+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:46:54.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.681+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21119517:::benchmark_data_smithi138_27857_object1479:head, will try copies on 0,4 2024-09-16T03:46:54.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.685+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:46:54.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.709+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:46:54.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:46:54.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.729+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:46:54.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.729+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:46:54.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.737+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:46:54.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.761+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:46:54.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.761+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:46:54.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:54.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.785+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:46:54.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.805+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:46:54.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.809+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:46:54.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.829+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:46:54.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.841+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:54.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.853+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:46:54.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.865+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:46:54.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.865+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:46:54.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.873+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:46:54.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.881+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:46:54.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.889+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:46:54.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.917+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:46:54.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.925+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:46:54.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:54.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:54.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:46:54.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:46:54.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.981+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:46:54.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:54.989+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:46:55.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.021+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5733f11e:::benchmark_data_smithi138_27857_object261:head, will try copies on 3,4 2024-09-16T03:46:55.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.029+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:46:55.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.033+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:55.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:46:55.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.053+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:55.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:46:55.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.129+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:46:55.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.153+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:46:55.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.153+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:46:55.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.169+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:46:55.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.173+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:46:55.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 309 16 3965366 3965350 801.978 808.125 0.000666867 0.00123507 2024-09-16T03:46:55.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.177+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:46:55.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.189+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:55.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:55.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.221+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76b0b5d:::benchmark_data_smithi138_27857_object1398:head, will try copies on 2,3 2024-09-16T03:46:55.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.233+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:55.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.241+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:46:55.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.257+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:46:55.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.261+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:46:55.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.273+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:46:55.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.305+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:55.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.325+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:46:55.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.329+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:46:55.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:46:55.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:46:55.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.353+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:46:55.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.377+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:46:55.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.381+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:46:55.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:46:55.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.425+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:46:55.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.429+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:46:55.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.437+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:46:55.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:46:55.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.457+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:46:55.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:46:55.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.477+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:46:55.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.481+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:46:55.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:46:55.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.509+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:46:55.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.513+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:46:55.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:46:55.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:46:55.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.561+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:46:55.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.577+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:55.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.581+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:46:55.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.589+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:46:55.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.601+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:46:55.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.609+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:46:55.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.621+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:46:55.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.629+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:46:55.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.641+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:46:55.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.641+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:46:55.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.657+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:46:55.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.661+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:46:55.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.661+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:46:55.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:46:55.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.681+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:46:55.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.685+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:46:55.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.701+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:46:55.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.713+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:46:55.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.733+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:46:55.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.737+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:46:55.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.749+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:55.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.749+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:46:55.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.753+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:46:55.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:55.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.773+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:46:55.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.785+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:55.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.793+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:46:55.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.797+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:46:55.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.801+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b2a0d2:::benchmark_data_smithi138_27857_object997:head, will try copies on 2,3 2024-09-16T03:46:55.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.837+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:46:55.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.841+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:46:55.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:46:55.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.869+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:46:55.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.877+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:46:55.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:46:55.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.889+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:46:55.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:46:55.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.905+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:46:55.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:46:55.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.917+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:46:55.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.921+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:46:55.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.937+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:55.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.957+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:55.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.965+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:46:55.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.969+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:46:55.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:55.981+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:46:56.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.001+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:46:56.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.013+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:46:56.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.021+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:46:56.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.025+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:46:56.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:46:56.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:46:56.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.061+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:46:56.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.065+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:46:56.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.077+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:46:56.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.097+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:46:56.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.109+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:46:56.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.113+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:46:56.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:56.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:46:56.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.161+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:46:56.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.165+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:46:56.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.165+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:46:56.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 310 16 3978226 3978210 801.984 803.75 0.000751591 0.00123505 2024-09-16T03:46:56.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.197+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:46:56.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.209+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:46:56.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.209+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:46:56.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.221+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:46:56.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.229+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:46:56.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.233+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:46:56.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.253+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:46:56.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:46:56.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.281+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:46:56.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.289+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:46:56.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.313+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:46:56.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.317+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:46:56.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.325+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:46:56.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:56.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:46:56.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.341+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:46:56.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.369+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:46:56.387 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:46:56.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.397+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:46:56.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.401+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:46:56.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.417+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:46:56.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.425+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:46:56.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.425+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:46:56.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.433+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:46:56.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.469+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:46:56.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:46:56.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.481+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:46:56.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.501+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:46:56.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.509+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:46:56.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.525+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:46:56.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.529+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:46:56.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.545+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:46:56.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.557+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:46:56.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.565+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:46:56.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.573+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:46:56.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:46:56.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.577+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:46:56.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.581+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:46:56.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.597+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:46:56.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.597+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:46:56.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.649+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:46:56.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:46:56.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.665+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:46:56.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.673+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:46:56.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.677+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:46:56.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.681+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:46:56.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.701+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:56.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.713+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:46:56.756 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.753+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:46:56.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.753+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:46:56.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.773+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe75d35:::benchmark_data_smithi138_27857_object1197:head, will try copies on 0,4 2024-09-16T03:46:56.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:46:56.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.785+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:46:56.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.797+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:46:56.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.797+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:46:56.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:46:56.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.821+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:56.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.873+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:46:56.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:46:56.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.901+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:46:56.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.905+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:46:56.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.917+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:46:56.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.933+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:46:56.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.937+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:56.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.961+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:46:56.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.969+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:56.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.989+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:46:57.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:56.997+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:46:57.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.005+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:46:57.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.005+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:46:57.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:46:57.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.013+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:46:57.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.045+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:46:57.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.049+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:46:57.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.049+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:46:57.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.061+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:46:57.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:46:57.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.081+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:46:57.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.085+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:46:57.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.101+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:46:57.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.109+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:46:57.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.113+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:46:57.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.133+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:46:57.149 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.145+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:46:57.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 311 16 3990829 3990813 801.937 787.688 0.000930996 0.00123514 2024-09-16T03:46:57.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:46:57.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.189+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:46:57.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.193+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:46:57.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.197+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:46:57.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.205+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:46:57.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.209+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:46:57.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.229+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:46:57.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.229+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:46:57.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.233+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:46:57.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:46:57.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.261+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:46:57.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.277+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:46:57.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:46:57.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.301+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:46:57.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.305+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:46:57.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.349+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:46:57.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.349+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:46:57.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.369+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:46:57.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.385+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:46:57.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.397+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:46:57.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.401+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:46:57.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.401+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:46:57.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.429+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:46:57.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.441+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:46:57.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:46:57.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.453+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:46:57.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.465+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:57.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.473+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:46:57.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:46:57.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.513+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:46:57.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.517+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:46:57.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.525+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:46:57.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.541+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:46:57.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.541+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:46:57.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.553+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:46:57.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.557+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:46:57.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.589+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:46:57.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.593+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:46:57.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.597+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:46:57.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.609+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:46:57.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.613+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:46:57.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.633+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:46:57.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.641+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:46:57.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.665+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:46:57.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:46:57.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.689+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:46:57.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.689+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:46:57.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:46:57.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.717+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:57.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.725+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:46:57.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.749+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:46:57.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.749+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:46:57.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:46:57.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.785+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:46:57.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.789+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:46:57.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.801+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:46:57.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.801+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:46:57.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.805+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f47973c:::benchmark_data_smithi138_27857_object2252:head, will try copies on 3,4 2024-09-16T03:46:57.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.821+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:46:57.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b439a61:::benchmark_data_smithi138_27857_object829:head, will try copies on 3,4 2024-09-16T03:46:57.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.825+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:46:57.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:46:57.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.865+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:46:57.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.877+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:46:57.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.893+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:46:57.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.893+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:57.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.897+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:46:57.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efcc8ab:::benchmark_data_smithi138_27857_object845:head, will try copies on 3,4 2024-09-16T03:46:57.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.925+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:46:57.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.937+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:46:57.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.949+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:46:57.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.973+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:57.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.977+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:57.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.981+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:46:57.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:57.989+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:46:58.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.021+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:572d7911:::benchmark_data_smithi138_27857_object2060:head, will try copies on 3,4 2024-09-16T03:46:58.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.049+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:46:58.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:46:58.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.065+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:46:58.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.077+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:46:58.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.093+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:46:58.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.109+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:46:58.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.117+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:46:58.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:58.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.133+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:46:58.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.133+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:46:58.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.153+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:46:58.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.161+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:46:58.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.165+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:46:58.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 312 16 4003724 4003708 801.95 805.938 0.000952987 0.00123512 2024-09-16T03:46:58.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.193+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:46:58.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.197+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:46:58.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:46:58.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.221+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:46:58.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.221+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:46:58.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.273+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:46:58.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.277+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:46:58.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.285+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9d1de4:::benchmark_data_smithi138_27857_object333:head, will try copies on 0,4 2024-09-16T03:46:58.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.289+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:46:58.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.301+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:46:58.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.305+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:46:58.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.309+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:46:58.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.313+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:46:58.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.341+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:46:58.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.341+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:46:58.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.365+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:46:58.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.385+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:46:58.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.389+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:46:58.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.397+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:46:58.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.425+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:46:58.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.433+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:46:58.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:46:58.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.457+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:46:58.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:46:58.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.477+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:46:58.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.489+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0f079b:::benchmark_data_smithi138_27857_object2422:head, will try copies on 0,4 2024-09-16T03:46:58.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.493+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:46:58.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.501+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:46:58.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.517+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:46:58.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.517+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:46:58.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.525+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:46:58.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:46:58.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.541+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:46:58.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.553+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:46:58.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.565+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:46:58.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.569+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:46:58.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:46:58.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.597+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:46:58.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.621+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:46:58.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:46:58.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:46:58.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.665+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:46:58.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:46:58.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:46:58.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.701+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:46:58.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.705+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:46:58.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.713+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:46:58.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.737+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:46:58.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.745+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:46:58.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.753+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:46:58.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.765+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:46:58.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.769+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:46:58.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.789+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:46:58.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.805+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:46:58.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.809+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:46:58.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.821+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:46:58.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.829+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:46:58.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.833+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:46:58.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.853+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:46:58.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:46:58.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.877+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:46:58.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:46:58.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.889+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:46:58.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.901+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:46:58.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.913+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:46:58.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:46:58.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.945+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:46:58.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.953+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:46:58.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:46:58.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.973+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:46:58.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.973+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:46:58.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.981+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:46:58.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:58.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:46:59.008 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.005+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:46:59.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:46:59.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.025+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:46:59.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.029+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:46:59.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:46:59.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:46:59.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.049+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:46:59.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.065+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:46:59.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.077+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:46:59.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.089+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:46:59.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.101+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:46:59.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:46:59.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.137+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:46:59.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.161+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:46:59.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:46:59.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.173+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:46:59.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 313 16 4016812 4016796 802.001 818 0.00171937 0.00123504 2024-09-16T03:46:59.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.189+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:46:59.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.193+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:46:59.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.209+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:46:59.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.233+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:46:59.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.249+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0bcefb:::benchmark_data_smithi138_27857_object145:head, will try copies on 3,4 2024-09-16T03:46:59.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.257+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:46:59.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.261+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:46:59.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.269+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:46:59.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.273+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:46:59.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.273+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:46:59.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.305+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:46:59.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.309+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:46:59.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.313+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:46:59.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.329+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:46:59.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:46:59.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.341+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:46:59.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.365+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:46:59.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.369+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:46:59.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.521+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:46:59.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.525+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:46:59.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.533+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:46:59.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.549+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:46:59.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.565+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:46:59.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912c585a:::benchmark_data_smithi138_27857_object2908:head, will try copies on 0,4 2024-09-16T03:46:59.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9305c57b:::benchmark_data_smithi138_27857_object1261:head, will try copies on 0,4 2024-09-16T03:46:59.605 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.601+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:46:59.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.601+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:46:59.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:46:59.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.641+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:46:59.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.649+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:46:59.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.661+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:46:59.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.681+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:46:59.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.697+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:46:59.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.721+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:46:59.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:46:59.765 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:46:59.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.769+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:46:59.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.773+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e86a61:::benchmark_data_smithi138_27857_object2613:head, will try copies on 2,3 2024-09-16T03:46:59.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:46:59.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.801+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:46:59.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.805+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:46:59.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.821+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:46:59.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.841+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:46:59.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.845+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:46:59.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.849+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:46:59.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:46:59.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:46:59.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.885+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:46:59.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:46:59.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.917+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:46:59.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.937+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:46:59.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.953+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:46:59.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.957+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dfdc45:::benchmark_data_smithi138_27857_object2461:head, will try copies on 2,3 2024-09-16T03:46:59.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.969+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:46:59.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.973+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:46:59.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.985+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:46:59.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.985+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:00.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:46:59.997+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:00.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:47:00.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:47:00.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.025+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:00.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.037+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:47:00.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.049+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:47:00.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.049+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:47:00.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.057+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:47:00.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.057+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:00.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.069+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:47:00.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.081+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:47:00.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.137+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:47:00.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.141+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95703d0:::benchmark_data_smithi138_27857_object2875:head, will try copies on 2,3 2024-09-16T03:47:00.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:00.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.165+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:00.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.173+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:47:00.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 314 16 4027299 4027283 801.534 655.438 0.000743241 0.00123576 2024-09-16T03:47:00.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:47:00.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.189+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:00.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:00.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.213+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c612804:::benchmark_data_smithi138_27857_object3962:head, will try copies on 3,4 2024-09-16T03:47:00.225 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.221+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:47:00.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb15799:::benchmark_data_smithi138_27857_object4071:head, will try copies on 2,3 2024-09-16T03:47:00.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.253+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:47:00.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.269+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:47:00.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.273+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:47:00.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.281+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:47:00.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.309+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:47:00.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.317+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:47:00.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.317+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:00.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.325+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:47:00.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.333+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:47:00.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.341+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:47:00.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.345+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:00.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.349+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:47:00.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.393+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:00.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.405+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:47:00.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.409+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:47:00.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.453+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63017584:::benchmark_data_smithi138_27857_object2281:head, will try copies on 3,4 2024-09-16T03:47:00.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.457+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:00.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:47:00.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.473+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:47:00.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.481+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:47:00.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.489+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:47:00.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.509+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:00.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:47:00.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.533+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:47:00.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.541+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:47:00.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.545+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:47:00.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.553+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:00.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.565+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:47:00.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.589+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:47:00.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.597+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:47:00.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.617+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:00.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:47:00.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.633+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:00.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.653+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:47:00.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.661+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:47:00.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.665+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:47:00.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.669+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:47:00.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.697+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:47:00.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.709+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:47:00.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.717+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:00.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.721+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:47:00.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.725+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:47:00.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.741+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:47:00.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.749+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:47:00.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.749+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:00.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.777+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96da6b7e:::benchmark_data_smithi138_27857_object1995:head, will try copies on 0,4 2024-09-16T03:47:00.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.785+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:00.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.793+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:47:00.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.805+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:47:00.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.821+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:47:00.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.837+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:47:00.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.841+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:00.858 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.853+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:00.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.869+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:47:00.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.869+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:47:00.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.901+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:47:00.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.905+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:47:00.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.913+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:47:00.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.921+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:00.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.933+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:00.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:47:00.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.949+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:47:00.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:47:00.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.977+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:47:00.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba745334:::benchmark_data_smithi138_27857_object1425:head, will try copies on 2,3 2024-09-16T03:47:00.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:00.993+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:47:01.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a924e39:::benchmark_data_smithi138_27857_object2459:head, will try copies on 3,4 2024-09-16T03:47:01.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.041+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:47:01.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.045+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:01.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.057+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:47:01.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.069+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:47:01.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.073+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:47:01.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.093+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:47:01.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.117+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:01.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.125+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:01.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.125+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:47:01.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.137+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:47:01.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.149+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5573d79c:::benchmark_data_smithi138_27857_object2902:head, will try copies on 3,4 2024-09-16T03:47:01.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.153+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:01.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 315 16 4040287 4040271 801.566 811.75 0.000774412 0.00123571 2024-09-16T03:47:01.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.177+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:47:01.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.181+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:47:01.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.197+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:47:01.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.221+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:47:01.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.221+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:47:01.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.233+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:47:01.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.237+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:47:01.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:47:01.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:47:01.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.265+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:47:01.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b0c1648:::benchmark_data_smithi138_27857_object1618:head, will try copies on 0,4 2024-09-16T03:47:01.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.281+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:47:01.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.301+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:47:01.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.313+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:47:01.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.325+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:47:01.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.329+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:47:01.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.345+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:01.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.349+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:01.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.361+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:47:01.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:47:01.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.417+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acab368:::benchmark_data_smithi138_27857_object543:head, will try copies on 0,4 2024-09-16T03:47:01.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.425+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:47:01.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.429+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:47:01.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.461+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:47:01.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.465+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:01.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.477+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:47:01.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.493+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:01.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.497+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:47:01.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.501+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:47:01.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.505+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:47:01.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.517+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:47:01.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.553+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:47:01.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.557+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:47:01.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:47:01.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.593+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:47:01.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:47:01.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.601+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:47:01.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.605+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:47:01.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.617+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:01.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.637+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:47:01.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.649+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:47:01.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.661+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:47:01.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.661+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:47:01.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.661+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:47:01.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.677+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:01.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.677+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:01.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.693+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:47:01.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.697+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:47:01.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.701+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:47:01.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be131dd:::benchmark_data_smithi138_27857_object2410:head, will try copies on 3,4 2024-09-16T03:47:01.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.725+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:47:01.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:47:01.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.733+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:47:01.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.753+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:47:01.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:01.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.765+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:47:01.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.793+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:01.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.801+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:47:01.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.801+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:47:01.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.801+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:47:01.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.825+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:47:01.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.833+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:47:01.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.837+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:47:01.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.861+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:01.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.869+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:47:01.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.877+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:47:01.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.881+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:47:01.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.889+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:47:01.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cdd1e5:::benchmark_data_smithi138_27857_object1132:head, will try copies on 3,4 2024-09-16T03:47:01.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.925+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:47:01.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.933+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:47:01.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:47:01.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:01.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.985+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:47:01.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.993+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:47:01.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.993+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:47:01.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:01.993+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:47:02.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:47:02.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.021+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:47:02.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:931b9b1e:::benchmark_data_smithi138_27857_object3156:head, will try copies on 0,4 2024-09-16T03:47:02.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.037+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5381a862:::benchmark_data_smithi138_27857_object4003:head, will try copies on 3,4 2024-09-16T03:47:02.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.045+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:02.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.057+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:02.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.073+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:02.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.093+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:47:02.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.097+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:47:02.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.109+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:47:02.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.113+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:47:02.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.137+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:47:02.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.137+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:47:02.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.161+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc7f835:::benchmark_data_smithi138_27857_object1842:head, will try copies on 3,4 2024-09-16T03:47:02.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.165+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:02.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 316 16 4052844 4052828 801.513 784.812 0.000888722 0.0012358 2024-09-16T03:47:02.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.177+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:02.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.193+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:47:02.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.193+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:47:02.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.201+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fabe1cc:::benchmark_data_smithi138_27857_object3334:head, will try copies on 3,4 2024-09-16T03:47:02.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.209+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:47:02.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.229+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:02.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.233+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:02.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:47:02.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.285+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:02.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.289+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:47:02.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.341+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:47:02.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.357+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:02.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.357+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:47:02.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.365+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3b462:::benchmark_data_smithi138_27857_object755:head, will try copies on 0,4 2024-09-16T03:47:02.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.373+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:47:02.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.397+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:47:02.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.433+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:47:02.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.445+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:47:02.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.457+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:47:02.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.461+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:47:02.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59728a18:::benchmark_data_smithi138_27857_object3327:head, will try copies on 3,4 2024-09-16T03:47:02.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.489+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:47:02.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.489+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:02.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:47:02.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.517+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:47:02.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.525+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:47:02.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.533+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:47:02.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:02.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:47:02.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.585+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:02.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.593+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:47:02.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:47:02.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.625+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:47:02.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:47:02.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:47:02.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.665+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:47:02.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.673+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:47:02.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.673+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:47:02.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.697+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:47:02.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.713+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:47:02.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.725+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:02.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.725+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:47:02.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.733+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:47:02.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:47:02.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.773+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:47:02.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:47:02.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.793+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:02.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.805+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:47:02.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.809+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:47:02.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.833+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:02.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.845+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b2dd0b:::benchmark_data_smithi138_27857_object3956:head, will try copies on 0,4 2024-09-16T03:47:02.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.849+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:47:02.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.853+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:47:02.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:47:02.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.877+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:02.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:47:02.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.925+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:47:02.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:47:02.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.945+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:47:02.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.961+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:47:02.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.973+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:47:02.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:02.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.985+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:47:02.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:02.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:47:03.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.009+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:47:03.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.017+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:03.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.025+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:47:03.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.045+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:47:03.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.065+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:03.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.065+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:47:03.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.073+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:47:03.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.085+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:03.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.085+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:47:03.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.109+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:03.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.125+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:47:03.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.133+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:03.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.157+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:47:03.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 317 16 4066170 4066154 801.612 832.875 0.00223318 0.00123565 2024-09-16T03:47:03.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.181+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:03.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.197+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:47:03.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:47:03.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.237+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:47:03.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.241+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:47:03.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.245+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:03.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.257+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:47:03.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.261+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:03.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.289+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:03.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.293+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:47:03.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.297+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:47:03.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.297+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:47:03.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.301+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:47:03.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.309+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:47:03.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.333+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:03.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.333+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:47:03.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.365+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:47:03.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.373+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:47:03.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:47:03.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.385+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:47:03.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:47:03.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.401+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:47:03.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.425+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:47:03.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:47:03.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.449+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:47:03.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.465+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:47:03.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.473+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:47:03.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.509+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:47:03.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.521+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:47:03.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.521+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:47:03.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.545+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:47:03.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.545+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:47:03.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.553+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:47:03.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.573+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:47:03.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.573+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:47:03.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.593+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:03.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.593+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:47:03.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.601+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9aa8f5:::benchmark_data_smithi138_27857_object2443:head, will try copies on 3,4 2024-09-16T03:47:03.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:47:03.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.621+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:47:03.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.637+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:03.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.645+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:47:03.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:47:03.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.665+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:03.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.689+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:47:03.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.693+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:47:03.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.701+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:47:03.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.717+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:47:03.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.729+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:47:03.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.729+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:47:03.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.745+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:03.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.749+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:47:03.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.757+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:47:03.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.785+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:47:03.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.785+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:47:03.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.793+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:47:03.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.801+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:47:03.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.805+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:47:03.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:47:03.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.833+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:47:03.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.837+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:47:03.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.873+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:03.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.873+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:47:03.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:47:03.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.877+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:47:03.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.897+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:47:03.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.913+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:656e4c8d:::benchmark_data_smithi138_27857_object1477:head, will try copies on 3,4 2024-09-16T03:47:03.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.917+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:03.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.929+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:03.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.941+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:03.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.953+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:47:03.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.957+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:47:03.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.965+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:47:03.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:03.977+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:47:04.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.001+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:04.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.033+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:47:04.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.057+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:47:04.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.085+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:47:04.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.085+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:47:04.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.089+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:04.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.101+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:47:04.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.125+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:47:04.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.125+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad09445:::benchmark_data_smithi138_27857_object611:head, will try copies on 3,4 2024-09-16T03:47:04.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.129+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:47:04.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.165+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2373a7bf:::benchmark_data_smithi138_27857_object627:head, will try copies on 0,4 2024-09-16T03:47:04.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 318 16 4079251 4079235 801.662 817.562 0.000619543 0.00123557 2024-09-16T03:47:04.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:04.189 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.185+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:04.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.205+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:47:04.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.205+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:47:04.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.209+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:47:04.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.217+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:47:04.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.241+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:47:04.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.245+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:04.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.257+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:47:04.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.269+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:47:04.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.273+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:47:04.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.273+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:47:04.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.277+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:47:04.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.281+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:47:04.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.285+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:47:04.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.305+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:47:04.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.309+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262d5bf1:::benchmark_data_smithi138_27857_object856:head, will try copies on 0,4 2024-09-16T03:47:04.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.325+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:47:04.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.337+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:47:04.353 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.349+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:47:04.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.349+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:47:04.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.373+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:47:04.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.373+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:47:04.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.377+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:47:04.394 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.389+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:47:04.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.397+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:47:04.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.401+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:47:04.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.401+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:47:04.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.421+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:04.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.449+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:47:04.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.449+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675aa448:::benchmark_data_smithi138_27857_object2348:head, will try copies on 3,4 2024-09-16T03:47:04.467 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.461+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:47:04.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.465+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:47:04.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.469+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:47:04.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:47:04.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.497+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:47:04.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.505+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:47:04.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.513+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:47:04.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.561+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:47:04.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.569+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:04.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.573+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:47:04.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.585+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:47:04.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.597+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:47:04.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.601+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:47:04.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.605+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:47:04.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.629+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:47:04.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.645+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:47:04.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.653+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:47:04.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.665+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:47:04.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.673+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:04.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.677+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e889a1:::benchmark_data_smithi138_27857_object1038:head, will try copies on 2,3 2024-09-16T03:47:04.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.697+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:47:04.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.701+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53012510:::benchmark_data_smithi138_27857_object2378:head, will try copies on 3,4 2024-09-16T03:47:04.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.717+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:47:04.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.741+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:47:04.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.741+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b44d4e:::benchmark_data_smithi138_27857_object1267:head, will try copies on 0,4 2024-09-16T03:47:04.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.753+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:47:04.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.757+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:47:04.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.769+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:04.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.777+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:04.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.793+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:47:04.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.805+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:47:04.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.809+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:47:04.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.817+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:47:04.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.825+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:47:04.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.837+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:47:04.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:47:04.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.853+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:47:04.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.861+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:04.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.869+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:47:04.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:47:04.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.881+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:04.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:47:04.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.953+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:47:04.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.957+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:04.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.977+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:04.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:47:04.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.993+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:04.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:04.993+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:47:05.006 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.001+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:47:05.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.029+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:47:05.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.037+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:47:05.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:47:05.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.061+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:47:05.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:05.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:47:05.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.093+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:05.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.097+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:47:05.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.113+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:05.118 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.113+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:05.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.125+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:47:05.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.137+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:47:05.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:05.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.157+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:47:05.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.157+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:47:05.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.169+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:47:05.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.173+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:47:05.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 319 15 4091907 4091892 801.628 791.062 0.00110866 0.00123561 2024-09-16T03:47:05.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.177+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6752547e:::benchmark_data_smithi138_27857_object732:head, will try copies on 3,4 2024-09-16T03:47:05.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.181+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:47:05.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.233+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:47:05.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.237+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:05.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:47:05.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.273+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf155a5:::benchmark_data_smithi138_27857_object2636:head, will try copies on 2,3 2024-09-16T03:47:05.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:05.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.325+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:47:05.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.345+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:47:05.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.353+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:47:05.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.369+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:47:05.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.377+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:47:05.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.377+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:47:05.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.393+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:47:05.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.397+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:47:05.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.425+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:47:05.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.433+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:47:05.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.437+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:05.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.457+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:47:05.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.465+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eeb10dd:::benchmark_data_smithi138_27857_object1001:head, will try copies on 3,4 2024-09-16T03:47:05.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.465+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:47:05.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.473+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:05.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.481+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:05.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.485+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:47:05.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.521+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:47:05.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:47:05.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.541+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:47:05.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.549+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:05.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.557+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e404efa:::benchmark_data_smithi138_27857_object3174:head, will try copies on 0,4 2024-09-16T03:47:05.564 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.561+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:47:05.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.573+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:47:05.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.597+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:47:05.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:47:05.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.605+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:47:05.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.629+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:05.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.629+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:47:05.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.637+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:47:05.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.649+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:47:05.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.673+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:47:05.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.689+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:47:05.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.705+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:47:05.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.709+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:47:05.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.713+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:47:05.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.745+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:05.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.749+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:930d5f02:::benchmark_data_smithi138_27857_object2853:head, will try copies on 0,4 2024-09-16T03:47:05.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.773+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:47:05.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:47:05.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.789+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:47:05.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.797+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:47:05.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.809+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:47:05.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.817+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:47:05.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.817+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de17ba8:::benchmark_data_smithi138_27857_object3078:head, will try copies on 0,4 2024-09-16T03:47:05.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.841+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:47:05.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:47:05.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.861+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:47:05.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.869+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:47:05.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.877+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:47:05.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.881+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:47:05.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1af69f9:::benchmark_data_smithi138_27857_object2784:head, will try copies on 2,3 2024-09-16T03:47:05.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.929+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:47:05.949 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.945+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:47:05.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.957+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:47:05.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.977+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:47:05.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.977+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:05.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.981+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:47:05.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:05.993+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:47:06.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.001+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:06.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.021+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:47:06.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.029+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:47:06.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:06.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.041+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f598261:::benchmark_data_smithi138_27857_object3258:head, will try copies on 3,4 2024-09-16T03:47:06.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.065+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:47:06.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.077+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:47:06.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.077+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:47:06.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.081+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:47:06.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.085+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:47:06.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.093+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:47:06.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:47:06.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:47:06.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.129+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:06.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.145+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:47:06.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.165+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:47:06.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.177+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:47:06.182 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:47:06.184150+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123556 2024-09-16T03:47:06.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:47:06.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 320 16 4104941 4104925 801.669 814.562 0.00115803 0.00123556 2024-09-16T03:47:06.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.205+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a6c914:::benchmark_data_smithi138_27857_object1444:head, will try copies on 0,4 2024-09-16T03:47:06.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.213+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:47:06.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.241+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:47:06.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.253+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:47:06.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.269+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:47:06.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.281+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:06.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.285+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:06.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.289+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:47:06.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.293+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:47:06.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.305+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:47:06.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:47:06.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.317+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:06.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.321+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:47:06.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.341+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:47:06.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.349+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:47:06.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.369+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:47:06.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.377+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:47:06.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.401+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:06.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.413+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:47:06.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.413+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:47:06.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.421+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e250e2e:::benchmark_data_smithi138_27857_object3794:head, will try copies on 0,4 2024-09-16T03:47:06.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.453+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:47:06.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.465+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:47:06.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.469+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:47:06.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.473+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:47:06.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.473+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:06.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.481+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:47:06.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.493+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:06.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.497+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:47:06.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.521+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:47:06.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.549+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:47:06.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.553+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:47:06.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.557+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:47:06.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.577+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:47:06.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.577+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:47:06.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.585+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:06.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.601+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:47:06.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:47:06.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.605+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:47:06.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.617+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9208eb94:::benchmark_data_smithi138_27857_object2172:head, will try copies on 0,4 2024-09-16T03:47:06.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.641+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:47:06.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.661+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:06.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.665+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:47:06.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.697+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:06.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:47:06.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.709+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:06.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.713+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:47:06.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.741+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2896a743:::benchmark_data_smithi138_27857_object307:head, will try copies on 0,4 2024-09-16T03:47:06.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.741+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:47:06.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:06.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:47:06.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.773+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:47:06.777 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.773+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:06.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.777+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:47:06.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:06.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:47:06.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.813+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:47:06.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.825+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:06.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.845+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:06.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.849+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:06.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.857+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:47:06.875 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.869+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:47:06.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.909+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:06.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.909+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:47:06.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.917+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:47:06.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.925+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:47:06.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.933+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:06.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.941+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:47:06.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.961+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:47:06.970 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.965+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:47:06.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:06.985+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:47:07.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.017+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:47:07.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.033+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:47:07.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.041+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:47:07.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.041+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:47:07.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.069+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:47:07.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.069+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:07.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.097+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:47:07.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.109+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:47:07.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.113+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:47:07.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.117+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:07.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.129+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:07.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.141+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:07.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.141+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:47:07.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.153+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:07.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.177+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:47:07.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 321 16 4117702 4117686 801.656 797.562 0.000667993 0.00123559 2024-09-16T03:47:07.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.185+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:47:07.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.197+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:47:07.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.221+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:47:07.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.221+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:47:07.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.249+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:47:07.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.249+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:47:07.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.257+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:47:07.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.269+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:47:07.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:07.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.281+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683726b5:::benchmark_data_smithi138_27857_object1412:head, will try copies on 3,4 2024-09-16T03:47:07.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.321+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3702dc:::benchmark_data_smithi138_27857_object2702:head, will try copies on 3,4 2024-09-16T03:47:07.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.341+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:07.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.341+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:07.360 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.357+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:07.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.357+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:07.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.381+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:47:07.388 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.385+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:47:07.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.397+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:47:07.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.397+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:47:07.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.421+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:47:07.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.437+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:07.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.441+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:47:07.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.441+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:07.459 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.453+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:47:07.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.465+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a70a429:::benchmark_data_smithi138_27857_object2632:head, will try copies on 0,4 2024-09-16T03:47:07.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.473+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:47:07.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.485+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:47:07.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:47:07.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.505+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:47:07.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.513+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd82ed49:::benchmark_data_smithi138_27857_object1326:head, will try copies on 2,3 2024-09-16T03:47:07.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.521+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:47:07.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.529+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:07.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.533+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:47:07.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.533+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:07.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.561+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:07.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.577+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:47:07.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.581+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:47:07.608 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.605+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:47:07.620 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.617+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:47:07.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:47:07.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.637+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:47:07.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.653+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:47:07.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.653+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:47:07.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:07.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:47:07.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.677+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:07.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.681+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:07.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.689+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:07.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.717+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:07.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.725+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:47:07.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.729+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:47:07.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.737+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:47:07.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.761+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:47:07.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.765+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:47:07.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.769+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:47:07.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.769+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:07.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.793+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:07.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.813+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:07.824 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.821+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:47:07.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.833+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:47:07.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.857+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:47:07.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.857+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:47:07.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.861+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:07.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.901+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:47:07.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.913+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:47:07.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.917+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:07.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.929+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:47:07.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.937+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:47:07.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.953+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:07.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.957+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:07.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.969+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:47:07.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.981+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:47:08.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:07.997+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4384170:::benchmark_data_smithi138_27857_object3878:head, will try copies on 2,3 2024-09-16T03:47:08.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.005+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d589a0e:::benchmark_data_smithi138_27857_object606:head, will try copies on 0,4 2024-09-16T03:47:08.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.013+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:47:08.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.013+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:47:08.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.045+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:47:08.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.057+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:47:08.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.057+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:962a920c:::benchmark_data_smithi138_27857_object3947:head, will try copies on 0,4 2024-09-16T03:47:08.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.089+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:47:08.093 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.089+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:47:08.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.105+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:47:08.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:47:08.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.121+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:47:08.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.137+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:47:08.148 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.145+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:08.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.169+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:47:08.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.173+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d0adbc:::benchmark_data_smithi138_27857_object320:head, will try copies on 3,4 2024-09-16T03:47:08.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.173+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:47:08.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 322 16 4130453 4130437 801.641 796.938 0.000909667 0.00123561 2024-09-16T03:47:08.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.177+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:47:08.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.205+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:47:08.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.209+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdc4ab2:::benchmark_data_smithi138_27857_object1775:head, will try copies on 3,4 2024-09-16T03:47:08.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.221+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:47:08.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.225+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:47:08.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.269+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:08.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:08.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.297+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:47:08.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.301+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:47:08.330 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.325+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b79f875:::benchmark_data_smithi138_27857_object1934:head, will try copies on 0,4 2024-09-16T03:47:08.363 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.357+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:08.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.373+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:47:08.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.385+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:47:08.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.401+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62f1fffe:::benchmark_data_smithi138_27857_object4115:head, will try copies on 3,4 2024-09-16T03:47:08.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.405+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:08.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.413+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:47:08.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:47:08.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.429+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:47:08.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.437+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:47:08.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.457+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:47:08.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.473+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:47:08.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.477+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:47:08.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.489+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:47:08.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.493+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:47:08.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.493+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:47:08.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.513+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:47:08.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.513+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:47:08.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.549+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:08.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.581+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:47:08.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.581+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:47:08.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.581+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:47:08.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.617+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:47:08.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.621+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:47:08.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.629+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57556f7c:::benchmark_data_smithi138_27857_object3589:head, will try copies on 3,4 2024-09-16T03:47:08.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:47:08.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.649+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:47:08.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.665+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:08.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.669+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:47:08.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.677+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:08.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:47:08.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.705+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:47:08.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.705+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:47:08.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.733+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:47:08.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.733+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:08.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.745+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:08.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.777+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:47:08.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.781+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:47:08.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.785+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:08.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.785+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:47:08.813 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.809+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:47:08.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.841+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:08.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.845+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:47:08.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.857+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:08.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.885+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:47:08.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.885+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:47:08.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.889+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90fda3:::benchmark_data_smithi138_27857_object1494:head, will try copies on 0,4 2024-09-16T03:47:08.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.925+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:47:08.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.933+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:47:08.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.937+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:47:08.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.945+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:47:08.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:08.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.969+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c5c52:::benchmark_data_smithi138_27857_object3342:head, will try copies on 3,4 2024-09-16T03:47:08.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.985+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:47:08.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:08.985+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:47:09.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.001+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b757072e:::benchmark_data_smithi138_27857_object1539:head, will try copies on 2,3 2024-09-16T03:47:09.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.013+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:47:09.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.013+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:09.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.037+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:47:09.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:47:09.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.053+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:47:09.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.073+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:47:09.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.077+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:09.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.093+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:09.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.109+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:09.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.121+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28faa6d3:::benchmark_data_smithi138_27857_object857:head, will try copies on 0,4 2024-09-16T03:47:09.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.125+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:47:09.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.141+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:47:09.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.149+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:47:09.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.161+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:47:09.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:47:09.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 323 16 4143846 4143830 801.75 837.062 0.000843511 0.00123543 2024-09-16T03:47:09.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.185+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c74cca:::benchmark_data_smithi138_27857_object3280:head, will try copies on 2,3 2024-09-16T03:47:09.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.193+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:47:09.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.201+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:47:09.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.217+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:47:09.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.233+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:47:09.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.237+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:47:09.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.241+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2666552f:::benchmark_data_smithi138_27857_object873:head, will try copies on 0,4 2024-09-16T03:47:09.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.253+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:47:09.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.277+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:47:09.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.281+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:47:09.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.305+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:47:09.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:47:09.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.317+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:09.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.325+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94407f92:::benchmark_data_smithi138_27857_object3757:head, will try copies on 0,4 2024-09-16T03:47:09.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.333+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:47:09.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.353+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:47:09.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:47:09.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.365+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:09.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.397+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285580a:::benchmark_data_smithi138_27857_object1327:head, will try copies on 3,4 2024-09-16T03:47:09.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.405+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:09.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.421+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5fb142:::benchmark_data_smithi138_27857_object2801:head, will try copies on 3,4 2024-09-16T03:47:09.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:47:09.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.441+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:47:09.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.469+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:47:09.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.521+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:09.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.525+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:47:09.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.557+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0eeacd:::benchmark_data_smithi138_27857_object245:head, will try copies on 3,4 2024-09-16T03:47:09.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.577+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:09.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.597+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:47:09.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.601+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:47:09.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.609+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:47:09.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:47:09.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.629+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d16699:::benchmark_data_smithi138_27857_object1281:head, will try copies on 0,4 2024-09-16T03:47:09.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.645+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:09.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:47:09.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.669+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:47:09.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.693+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:47:09.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.721+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:09.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.721+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:47:09.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.721+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1dc962:::benchmark_data_smithi138_27857_object1576:head, will try copies on 0,4 2024-09-16T03:47:09.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.725+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:47:09.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.733+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6459fa1b:::benchmark_data_smithi138_27857_object1915:head, will try copies on 3,4 2024-09-16T03:47:09.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.765+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:47:09.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.777+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:47:09.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.781+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:47:09.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.797+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:47:09.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.797+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:47:09.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.805+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:47:09.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.825+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:47:09.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.829+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:47:09.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.849+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:47:09.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.853+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:47:09.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.857+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:47:09.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.889+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:09.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.893+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:47:09.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.893+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:09.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:09.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.933+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:47:09.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.933+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:09.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.953+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:09.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.977+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:09.983 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.977+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:47:09.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.981+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:47:09.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:09.993+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:47:10.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.005+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:47:10.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.005+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:47:10.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.021+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508c316a:::benchmark_data_smithi138_27857_object482:head, will try copies on 3,4 2024-09-16T03:47:10.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.025+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:10.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.037+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:47:10.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.041+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:10.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.057+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:47:10.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.061+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:47:10.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.073+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:47:10.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.081+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:47:10.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.085+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:10.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.121+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:47:10.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.125+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:47:10.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.141+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:47:10.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.157+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:47:10.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.169+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:10.176 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.173+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:47:10.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.173+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:47:10.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.177+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:47:10.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 324 16 4156073 4156057 801.634 764.188 0.000412064 0.00123561 2024-09-16T03:47:10.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.181+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:10.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.185+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:47:10.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.225+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1210330:::benchmark_data_smithi138_27857_object741:head, will try copies on 2,3 2024-09-16T03:47:10.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.237+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:47:10.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.245+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:47:10.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.249+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:47:10.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.253+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:47:10.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.269+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:10.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.281+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5258f521:::benchmark_data_smithi138_27857_object2665:head, will try copies on 3,4 2024-09-16T03:47:10.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.289+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64952f07:::benchmark_data_smithi138_27857_object2360:head, will try copies on 3,4 2024-09-16T03:47:10.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.301+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:47:10.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.313+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:47:10.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.317+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:10.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:47:10.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.345+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:47:10.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.345+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:10.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.361+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:47:10.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.373+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beb911c6:::benchmark_data_smithi138_27857_object179:head, will try copies on 2,3 2024-09-16T03:47:10.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:47:10.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.385+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:47:10.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.393+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:47:10.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.401+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:10.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.421+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:47:10.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.425+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:47:10.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.441+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:47:10.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.465+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:47:10.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.477+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:10.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.481+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:47:10.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.485+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:47:10.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:47:10.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.533+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:47:10.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.533+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:47:10.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.545+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:47:10.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.549+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:10.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.557+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992c8fdb:::benchmark_data_smithi138_27857_object13:head, will try copies on 0,4 2024-09-16T03:47:10.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.561+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57da0bc0:::benchmark_data_smithi138_27857_object4128:head, will try copies on 3,4 2024-09-16T03:47:10.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.565+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:47:10.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.585+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:47:10.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.589+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:47:10.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.605+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:47:10.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.633+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:47:10.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.637+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:47:10.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.641+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:47:10.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.657+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:47:10.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.661+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:47:10.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.685+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:10.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.697+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:47:10.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.697+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:47:10.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.705+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:10.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:47:10.743 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.737+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:47:10.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.745+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:47:10.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.749+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:47:10.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.765+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fac4eee:::benchmark_data_smithi138_27857_object2429:head, will try copies on 0,4 2024-09-16T03:47:10.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.765+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:47:10.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.777+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:47:10.782 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.777+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:47:10.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.797+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cbdc25:::benchmark_data_smithi138_27857_object3649:head, will try copies on 3,4 2024-09-16T03:47:10.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.805+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4962e6:::benchmark_data_smithi138_27857_object1530:head, will try copies on 0,4 2024-09-16T03:47:10.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.813+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:47:10.839 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.833+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:47:10.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.845+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:47:10.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.845+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:47:10.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.869+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a0b5f6:::benchmark_data_smithi138_27857_object3309:head, will try copies on 2,3 2024-09-16T03:47:10.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.873+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:10.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.885+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:47:10.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.889+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:10.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.897+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:47:10.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.925+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:47:10.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.929+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:47:10.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.933+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:47:10.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.941+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:47:10.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.941+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:47:10.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.965+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:47:10.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.973+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:10.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.985+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:47:10.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:10.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:47:11.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.017+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9538619b:::benchmark_data_smithi138_27857_object2191:head, will try copies on 0,4 2024-09-16T03:47:11.023 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.017+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:47:11.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.029+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:47:11.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.041+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:11.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.049+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:11.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.049+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:47:11.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.057+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:11.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.065+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:11.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:11.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.089+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2029751:::benchmark_data_smithi138_27857_object4054:head, will try copies on 2,3 2024-09-16T03:47:11.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.093+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:47:11.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.121+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:47:11.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.129+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:47:11.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.129+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d7dff3:::benchmark_data_smithi138_27857_object1657:head, will try copies on 0,4 2024-09-16T03:47:11.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.133+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:47:11.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.149+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:47:11.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.173+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564bd0e7:::benchmark_data_smithi138_27857_object278:head, will try copies on 3,4 2024-09-16T03:47:11.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 325 16 4169141 4169125 801.68 816.75 0.000917985 0.00123555 2024-09-16T03:47:11.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.189+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:47:11.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.201+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:47:11.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.205+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:47:11.220 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.213+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:47:11.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.217+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:47:11.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.221+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07088af:::benchmark_data_smithi138_27857_object1991:head, will try copies on 2,3 2024-09-16T03:47:11.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.229+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb2d470:::benchmark_data_smithi138_27857_object2601:head, will try copies on 0,4 2024-09-16T03:47:11.252 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.249+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:11.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.257+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:47:11.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.257+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:11.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.277+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:47:11.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.301+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa6145f:::benchmark_data_smithi138_27857_object3438:head, will try copies on 0,4 2024-09-16T03:47:11.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.301+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dc3dd2d:::benchmark_data_smithi138_27857_object462:head, will try copies on 3,4 2024-09-16T03:47:11.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.313+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:47:11.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:47:11.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.321+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:11.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.337+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:47:11.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.361+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:47:11.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.369+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:47:11.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.381+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:47:11.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.381+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:47:11.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.397+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:11.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:47:11.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.417+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:47:11.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.445+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:47:11.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.465+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:47:11.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.469+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:11.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.477+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:47:11.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.497+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:47:11.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.505+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bd02a5:::benchmark_data_smithi138_27857_object2507:head, will try copies on 2,3 2024-09-16T03:47:11.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.509+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:47:11.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.513+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:47:11.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.521+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:47:11.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:47:11.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.553+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:47:11.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.557+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:47:11.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.577+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:47:11.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.585+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:11.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.637+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:47:11.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.653+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:47:11.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.657+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:47:11.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.661+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:11.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.685+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:47:11.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.697+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:11.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.705+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:47:11.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.721+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:47:11.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.729+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:47:11.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.737+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:11.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.737+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:11.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.745+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:47:11.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.757+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:47:11.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.769+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:11.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.781+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6676263:::benchmark_data_smithi138_27857_object2357:head, will try copies on 2,3 2024-09-16T03:47:11.787 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.781+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:47:11.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.821+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:47:11.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.853+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9ddc2e:::benchmark_data_smithi138_27857_object415:head, will try copies on 3,4 2024-09-16T03:47:11.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.853+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:47:11.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.877+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:47:11.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.893+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:47:11.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.897+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:47:11.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.913+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:11.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.913+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:47:11.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.921+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:11.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.937+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:47:11.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.957+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:11.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.961+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d66bcff:::benchmark_data_smithi138_27857_object1446:head, will try copies on 0,4 2024-09-16T03:47:11.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.965+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:47:11.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.981+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:47:11.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:11.993+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e4dd58:::benchmark_data_smithi138_27857_object1332:head, will try copies on 2,3 2024-09-16T03:47:12.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.001+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:47:12.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.001+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:47:12.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.001+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:12.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.009+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:47:12.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:12.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.029+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:12.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.061+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:12.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.093+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:47:12.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.101+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:12.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.113+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:47:12.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.129+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:47:12.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.133+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:47:12.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.145+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:12.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:47:12.158 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.153+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:47:12.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:47:12.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 326 16 4182232 4182216 801.731 818.188 0.000554662 0.00123546 2024-09-16T03:47:12.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.181+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:47:12.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.185+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eff528b:::benchmark_data_smithi138_27857_object3735:head, will try copies on 0,4 2024-09-16T03:47:12.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.189+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52fd5523:::benchmark_data_smithi138_27857_object1849:head, will try copies on 3,4 2024-09-16T03:47:12.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.225+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:47:12.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.233+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:47:12.253 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.249+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:47:12.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.257+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:47:12.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.277+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:47:12.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.281+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:47:12.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.305+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:47:12.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.309+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa7c8b9:::benchmark_data_smithi138_27857_object3828:head, will try copies on 3,4 2024-09-16T03:47:12.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.317+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:47:12.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.337+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:47:12.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.361+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:47:12.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.369+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:47:12.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.381+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5faa460a:::benchmark_data_smithi138_27857_object1862:head, will try copies on 3,4 2024-09-16T03:47:12.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.397+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:47:12.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.417+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fc1ed:::benchmark_data_smithi138_27857_object3118:head, will try copies on 0,4 2024-09-16T03:47:12.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.429+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:47:12.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.433+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:12.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.437+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:47:12.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.441+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:47:12.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.449+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:684f54b8:::benchmark_data_smithi138_27857_object1664:head, will try copies on 3,4 2024-09-16T03:47:12.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.473+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:47:12.497 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.493+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:47:12.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.505+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:47:12.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.521+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:47:12.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.525+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:47:12.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.525+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:47:12.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.533+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:47:12.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.557+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:47:12.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.561+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:47:12.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.577+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:12.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.581+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:12.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.593+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:47:12.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.617+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:12.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.629+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:47:12.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.653+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:47:12.661 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.657+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:12.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.665+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:47:12.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.665+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:47:12.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.693+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:47:12.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.697+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:47:12.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.705+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:47:12.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.721+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547131aa:::benchmark_data_smithi138_27857_object160:head, will try copies on 3,4 2024-09-16T03:47:12.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.725+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:47:12.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.741+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:47:12.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.749+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:47:12.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.753+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:47:12.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.769+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:47:12.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.785+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:47:12.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.793+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:47:12.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.813+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:47:12.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.829+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:47:12.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.829+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:47:12.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.857+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:47:12.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.861+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:47:12.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.865+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:12.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.873+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:47:12.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.893+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:47:12.903 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.897+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:47:12.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.905+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:12.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.921+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:47:12.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.929+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:47:12.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.933+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:47:12.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.941+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28693f26:::benchmark_data_smithi138_27857_object164:head, will try copies on 0,4 2024-09-16T03:47:12.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.953+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1dcc914:::benchmark_data_smithi138_27857_object901:head, will try copies on 2,3 2024-09-16T03:47:12.957 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.953+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:47:12.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.965+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d83aac1:::benchmark_data_smithi138_27857_object3344:head, will try copies on 3,4 2024-09-16T03:47:12.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:12.965+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:13.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.001+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:13.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.021+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:13.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.037+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:47:13.046 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.041+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:47:13.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.057+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:13.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.061+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:47:13.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.081+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:47:13.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.101+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:13.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.113+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:13.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.113+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:47:13.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.113+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:47:13.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.133+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ece0ef:::benchmark_data_smithi138_27857_object2206:head, will try copies on 3,4 2024-09-16T03:47:13.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.133+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:47:13.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.141+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:13.164 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.161+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:47:13.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.165+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:47:13.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 327 15 4195219 4195204 801.761 811.75 0.00114912 0.00123541 2024-09-16T03:47:13.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.181+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5275a18b:::benchmark_data_smithi138_27857_object2697:head, will try copies on 3,4 2024-09-16T03:47:13.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.197+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde286fb:::benchmark_data_smithi138_27857_object591:head, will try copies on 2,3 2024-09-16T03:47:13.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.213+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:47:13.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.229+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:47:13.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.233+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:47:13.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.241+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:47:13.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.245+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:13.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.253+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becfc09a:::benchmark_data_smithi138_27857_object293:head, will try copies on 2,3 2024-09-16T03:47:13.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.277+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:47:13.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.277+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:47:13.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.297+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f48467a:::benchmark_data_smithi138_27857_object1165:head, will try copies on 3,4 2024-09-16T03:47:13.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.309+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:47:13.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.317+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28e564ac:::benchmark_data_smithi138_27857_object57:head, will try copies on 0,4 2024-09-16T03:47:13.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.333+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:47:13.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.369+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:47:13.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.377+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:47:13.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.393+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:47:13.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.421+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:13.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.425+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:47:13.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.437+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:47:13.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.465+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:13.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.473+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:47:13.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.477+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:47:13.506 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.501+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:47:13.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.505+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:47:13.517 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.513+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:47:13.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.517+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:47:13.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.525+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:47:13.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.529+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:47:13.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.533+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:47:13.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.561+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95540564:::benchmark_data_smithi138_27857_object480:head, will try copies on 0,4 2024-09-16T03:47:13.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.585+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:47:13.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.589+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:47:13.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.605+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:47:13.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.609+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:47:13.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.613+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:13.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.617+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8093d9c:::benchmark_data_smithi138_27857_object1434:head, will try copies on 2,3 2024-09-16T03:47:13.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.621+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:47:13.630 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.625+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:47:13.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.657+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:47:13.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.669+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:13.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.681+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:47:13.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.697+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:47:13.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.709+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:47:13.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.717+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:47:13.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.729+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:47:13.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.733+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b068a086:::benchmark_data_smithi138_27857_object3618:head, will try copies on 2,3 2024-09-16T03:47:13.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.749+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:47:13.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.757+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:47:13.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.781+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:13.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.785+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:47:13.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.789+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:47:13.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.793+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3493a1:::benchmark_data_smithi138_27857_object3150:head, will try copies on 2,3 2024-09-16T03:47:13.805 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.801+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:47:13.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.805+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:47:13.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.817+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:47:13.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.829+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:13.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.845+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:13.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.889+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c79f025:::benchmark_data_smithi138_27857_object1770:head, will try copies on 3,4 2024-09-16T03:47:13.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.897+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:47:13.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.897+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe9a8cc:::benchmark_data_smithi138_27857_object1362:head, will try copies on 2,3 2024-09-16T03:47:13.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.905+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:47:13.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.921+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:47:13.932 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.929+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:47:13.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.949+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:13.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.953+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26f26407:::benchmark_data_smithi138_27857_object1751:head, will try copies on 0,4 2024-09-16T03:47:13.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.961+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:47:13.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.989+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:47:13.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:13.989+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:47:14.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.013+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961ccc8c:::benchmark_data_smithi138_27857_object1970:head, will try copies on 0,4 2024-09-16T03:47:14.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.029+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:47:14.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.037+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c4162df:::benchmark_data_smithi138_27857_object2050:head, will try copies on 0,4 2024-09-16T03:47:14.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.045+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:47:14.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.065+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:14.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.073+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:47:14.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.081+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bbb522:::benchmark_data_smithi138_27857_object346:head, will try copies on 3,4 2024-09-16T03:47:14.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.081+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:47:14.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.105+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:47:14.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.129+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:47:14.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.149+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:14.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.157+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc9ea3b8:::benchmark_data_smithi138_27857_object1567:head, will try copies on 2,3 2024-09-16T03:47:14.163 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.157+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:14.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 328 16 4208138 4208122 801.778 807.375 0.000771402 0.0012354 2024-09-16T03:47:14.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.193+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:14.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.193+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:47:14.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.225+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:47:14.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.233+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:47:14.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.241+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:47:14.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.245+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b130b6fe:::benchmark_data_smithi138_27857_object3804:head, will try copies on 2,3 2024-09-16T03:47:14.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.257+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:47:14.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.261+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:14.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.277+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:47:14.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.285+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:47:14.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.297+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:14.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.309+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:47:14.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.321+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:14.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.321+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:47:14.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.329+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69ef251b:::benchmark_data_smithi138_27857_object3833:head, will try copies on 3,4 2024-09-16T03:47:14.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.345+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2698d396:::benchmark_data_smithi138_27857_object2557:head, will try copies on 0,4 2024-09-16T03:47:14.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.373+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:47:14.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.373+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66c440e7:::benchmark_data_smithi138_27857_object3332:head, will try copies on 3,4 2024-09-16T03:47:14.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.377+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:14.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.397+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:47:14.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.409+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:47:14.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.413+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:47:14.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:47:14.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:47:14.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.456+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:47:14.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.468+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:14.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.468+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:14.591 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.524+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:47:14.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.620+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:14.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.652+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:47:14.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.668+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:47:14.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:47:14.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.712+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:14.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.712+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:47:14.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.720+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:47:14.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.732+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:47:14.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.740+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:14.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.752+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:47:14.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.768+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:47:14.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.772+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:14.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:47:14.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.804+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:47:14.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.816+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:14.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.824+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:47:14.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.848+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:47:14.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.852+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:47:14.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.852+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:14.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.856+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:47:14.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.880+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:47:14.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.892+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:47:14.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.900+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:47:14.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.916+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:47:14.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.944+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:14.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.956+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:14.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.960+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:14.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:47:14.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.976+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:47:14.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:47:15.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:14.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:47:15.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.008+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:47:15.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.032+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:15.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.036+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:15.055 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:47:15.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.056+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:15.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.056+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:47:15.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.076+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:47:15.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.084+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:15.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.096+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:47:15.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:47:15.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.120+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:47:15.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.140+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:47:15.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.160+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:47:15.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.160+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:47:15.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 329 16 4218825 4218809 801.371 667.938 0.000781605 0.00123602 2024-09-16T03:47:15.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:47:15.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.204+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:47:15.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:47:15.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.232+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507375e6:::benchmark_data_smithi138_27857_object2310:head, will try copies on 3,4 2024-09-16T03:47:15.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.232+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:47:15.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.236+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b1229dc:::benchmark_data_smithi138_27857_object409:head, will try copies on 0,4 2024-09-16T03:47:15.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.240+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:47:15.264 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.260+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:47:15.291 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.284+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:47:15.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.296+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:47:15.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.320+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:47:15.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.328+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:47:15.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52b042c:::benchmark_data_smithi138_27857_object1311:head, will try copies on 2,3 2024-09-16T03:47:15.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.344+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:47:15.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:15.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.368+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:15.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.372+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:47:15.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.388+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:15.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.396+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:47:15.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.428+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:47:15.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:47:15.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.436+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:47:15.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.440+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:47:15.464 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.460+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d4530:::benchmark_data_smithi138_27857_object490:head, will try copies on 0,4 2024-09-16T03:47:15.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.468+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:47:15.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.468+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:47:15.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.472+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:47:15.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.500+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:47:15.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.504+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:47:15.514 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.508+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:47:15.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:47:15.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.560+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:47:15.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.568+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:15.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:47:15.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.588+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:47:15.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.604+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:15.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.616+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:47:15.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:15.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.640+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:15.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.684+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:47:15.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.688+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:15.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.692+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:47:15.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.704+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:47:15.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.708+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:15.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.740+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:47:15.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.752+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:47:15.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.764+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:47:15.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.772+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:47:15.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:47:15.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.792+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:47:15.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.796+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:47:15.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.824+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:47:15.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.832+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528c3d41:::benchmark_data_smithi138_27857_object4087:head, will try copies on 3,4 2024-09-16T03:47:15.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:47:15.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.872+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6337cb22:::benchmark_data_smithi138_27857_object2773:head, will try copies on 3,4 2024-09-16T03:47:15.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:15.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.896+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:15.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:47:15.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.940+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:47:15.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:47:15.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.976+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:47:15.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:47:16.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:15.996+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:47:16.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.016+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:47:16.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.040+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:16.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.044+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aebddee:::benchmark_data_smithi138_27857_object3916:head, will try copies on 0,4 2024-09-16T03:47:16.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:47:16.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:16.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.068+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6103c571:::benchmark_data_smithi138_27857_object4043:head, will try copies on 3,4 2024-09-16T03:47:16.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.124+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:16.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:47:16.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.128+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:47:16.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.148+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:16.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.148+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:16.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.164+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:16.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 330 15 4232203 4232188 801.476 836.188 0.000765434 0.00123586 2024-09-16T03:47:16.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.192+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:16.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.196+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:47:16.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:47:16.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.208+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:47:16.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:16.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.224+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:47:16.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.236+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:16.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.252+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:47:16.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.264+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:16.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.288+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:47:16.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.292+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:47:16.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.308+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9da8afb:::benchmark_data_smithi138_27857_object2474:head, will try copies on 2,3 2024-09-16T03:47:16.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.312+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:47:16.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.324+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:47:16.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:47:16.343 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.336+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:47:16.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.348+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:47:16.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.356+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:47:16.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.360+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:47:16.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.372+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:47:16.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.404+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:47:16.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.412+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:47:16.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.412+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:47:16.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.428+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:47:16.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.448+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:47:16.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.460+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:47:16.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:16.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.468+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d7be1a:::benchmark_data_smithi138_27857_object421:head, will try copies on 0,4 2024-09-16T03:47:16.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:47:16.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.496+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:47:16.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.512+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:47:16.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.520+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:47:16.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.532+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:47:16.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.536+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:47:16.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:47:16.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.568+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:16.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.596+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:47:16.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.600+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:47:16.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:47:16.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.628+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:47:16.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.628+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:16.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.636+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:47:16.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:47:16.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:47:16.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.672+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:47:16.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.680+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:47:16.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:47:16.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.696+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:47:16.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.720+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:47:16.738 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:47:16.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.740+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:16.748 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.744+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:16.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.756+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:47:16.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.776+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:47:16.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.780+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:47:16.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2490fbf7:::benchmark_data_smithi138_27857_object417:head, will try copies on 0,4 2024-09-16T03:47:16.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:47:16.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:47:16.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.804+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:47:16.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.820+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:47:16.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.844+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b998456b:::benchmark_data_smithi138_27857_object1389:head, will try copies on 2,3 2024-09-16T03:47:16.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.848+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:47:16.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.860+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:47:16.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.864+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:47:16.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.884+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:47:16.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.896+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:47:16.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.920+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:16.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.932+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:47:16.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.944+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:47:16.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.948+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:47:16.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947a4ad6:::benchmark_data_smithi138_27857_object3855:head, will try copies on 0,4 2024-09-16T03:47:16.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:47:16.984 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:47:16.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:16.992+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:47:17.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:47:17.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.024+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:17.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.036+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:17.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.052+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:47:17.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.072+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:17.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.084+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:17.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.092+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:47:17.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.104+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5d5ef3:::benchmark_data_smithi138_27857_object3561:head, will try copies on 0,4 2024-09-16T03:47:17.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.104+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:17.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.120+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:47:17.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:47:17.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:47:17.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.140+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:47:17.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.156+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:47:17.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:47:17.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.172+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:47:17.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:47:17.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 331 16 4244954 4244938 801.462 796.875 0.00196743 0.00123588 2024-09-16T03:47:17.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.188+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:47:17.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.204+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:47:17.210 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.204+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:47:17.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.224+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:47:17.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.236+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:47:17.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.244+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:47:17.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:47:17.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.280+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:47:17.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.280+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b663f523:::benchmark_data_smithi138_27857_object1572:head, will try copies on 2,3 2024-09-16T03:47:17.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.284+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:47:17.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.284+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:47:17.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.308+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:47:17.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.344+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:17.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.364+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:47:17.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.364+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:47:17.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.376+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:47:17.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.380+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54897335:::benchmark_data_smithi138_27857_object1401:head, will try copies on 3,4 2024-09-16T03:47:17.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.392+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:47:17.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.392+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:47:17.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.408+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:47:17.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:47:17.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.432+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:47:17.444 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.440+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:47:17.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:17.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.480+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:47:17.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e11fed:::benchmark_data_smithi138_27857_object77:head, will try copies on 3,4 2024-09-16T03:47:17.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.492+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:17.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.492+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6e4ad5:::benchmark_data_smithi138_27857_object474:head, will try copies on 0,4 2024-09-16T03:47:17.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.500+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:17.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.512+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:17.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:17.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.532+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:47:17.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:47:17.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.536+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:47:17.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.548+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:17.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9d2a4b:::benchmark_data_smithi138_27857_object1982:head, will try copies on 0,4 2024-09-16T03:47:17.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.588+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:17.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.604+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:47:17.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:47:17.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:47:17.662 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:47:17.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.684+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:47:17.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:47:17.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.704+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:47:17.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.712+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:47:17.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.716+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:47:17.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.720+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2a3fd9:::benchmark_data_smithi138_27857_object1337:head, will try copies on 2,3 2024-09-16T03:47:17.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.724+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3d46b0:::benchmark_data_smithi138_27857_object1792:head, will try copies on 3,4 2024-09-16T03:47:17.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:47:17.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.752+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:17.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.752+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:47:17.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.772+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f49ca:::benchmark_data_smithi138_27857_object1747:head, will try copies on 3,4 2024-09-16T03:47:17.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.780+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:17.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.804+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:17.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:47:17.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.816+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:47:17.844 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.840+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:17.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.840+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:47:17.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.840+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:17.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.848+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:47:17.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:17.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:47:17.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.904+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:17.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.908+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:47:17.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.908+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:47:17.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.916+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:47:17.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.940+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:47:17.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.948+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928642eb:::benchmark_data_smithi138_27857_object880:head, will try copies on 0,4 2024-09-16T03:47:17.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.956+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:47:17.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.956+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:17.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:18.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:17.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:47:18.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.020+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:47:18.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.020+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:47:18.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.024+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5227e3fc:::benchmark_data_smithi138_27857_object3971:head, will try copies on 3,4 2024-09-16T03:47:18.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.036+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:47:18.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:18.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.088+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:47:18.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.104+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:47:18.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.108+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:47:18.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2227d5a9:::benchmark_data_smithi138_27857_object3399:head, will try copies on 0,4 2024-09-16T03:47:18.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:47:18.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.136+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:47:18.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.164+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:47:18.183 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 332 16 4257732 4257716 801.453 798.625 0.000917867 0.0012359 2024-09-16T03:47:18.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.180+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:47:18.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.180+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:47:18.190 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.184+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:47:18.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.188+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b1c6f1:::benchmark_data_smithi138_27857_object93:head, will try copies on 3,4 2024-09-16T03:47:18.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.212+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:47:18.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:47:18.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.232+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:18.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.256+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bdf52e:::benchmark_data_smithi138_27857_object3748:head, will try copies on 2,3 2024-09-16T03:47:18.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2560a031:::benchmark_data_smithi138_27857_object109:head, will try copies on 0,4 2024-09-16T03:47:18.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.256+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dad34a6:::benchmark_data_smithi138_27857_object3676:head, will try copies on 0,4 2024-09-16T03:47:18.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.272+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:47:18.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:47:18.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.304+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:18.314 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:18.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.316+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:47:18.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:47:18.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.336+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:47:18.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.340+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5189568b:::benchmark_data_smithi138_27857_object2072:head, will try copies on 3,4 2024-09-16T03:47:18.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.348+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:47:18.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.368+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:47:18.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.372+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab757b9:::benchmark_data_smithi138_27857_object344:head, will try copies on 3,4 2024-09-16T03:47:18.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.376+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:47:18.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.388+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:47:18.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.408+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:47:18.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.420+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:18.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:47:18.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.432+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:18.439 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.432+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:47:18.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:47:18.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.468+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:47:18.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.476+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:47:18.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.488+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:47:18.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:47:18.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.540+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3ce5f7:::benchmark_data_smithi138_27857_object370:head, will try copies on 3,4 2024-09-16T03:47:18.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:18.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.552+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:47:18.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.556+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:18.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:47:18.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.580+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:47:18.595 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.588+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:47:18.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.608+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:47:18.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:18.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.636+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8f7e6a:::benchmark_data_smithi138_27857_object3123:head, will try copies on 0,4 2024-09-16T03:47:18.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.644+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:18.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:47:18.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.648+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:18.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.664+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:47:18.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.668+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:47:18.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.684+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:47:18.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.700+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58c58c7:::benchmark_data_smithi138_27857_object1652:head, will try copies on 2,3 2024-09-16T03:47:18.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:47:18.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.728+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:47:18.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.752+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:47:18.771 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.764+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:47:18.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.768+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:47:18.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:47:18.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.804+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:47:18.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.824+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:47:18.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.824+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:47:18.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:18.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:18.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.860+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1034e48:::benchmark_data_smithi138_27857_object1617:head, will try copies on 2,3 2024-09-16T03:47:18.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.868+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2967094d:::benchmark_data_smithi138_27857_object3100:head, will try copies on 0,4 2024-09-16T03:47:18.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.876+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:47:18.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.916+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:47:18.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.928+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:47:18.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.928+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:47:18.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.956+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:47:18.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd319570:::benchmark_data_smithi138_27857_object2212:head, will try copies on 2,3 2024-09-16T03:47:18.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:47:18.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.976+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:18.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:18.992+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:47:19.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.008+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:19.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.020+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:19.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.020+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:47:19.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.028+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9facc4c9:::benchmark_data_smithi138_27857_object2679:head, will try copies on 0,4 2024-09-16T03:47:19.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.044+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:19.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.056+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:47:19.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.068+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:47:19.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d3d54ac:::benchmark_data_smithi138_27857_object3336:head, will try copies on 3,4 2024-09-16T03:47:19.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.084+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94595167:::benchmark_data_smithi138_27857_object3944:head, will try copies on 0,4 2024-09-16T03:47:19.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.128+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:47:19.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.132+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd971c0:::benchmark_data_smithi138_27857_object1453:head, will try copies on 2,3 2024-09-16T03:47:19.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.144+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:47:19.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.156+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:47:19.162 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.156+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089fe50:::benchmark_data_smithi138_27857_object2496:head, will try copies on 0,4 2024-09-16T03:47:19.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:19.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.172+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:47:19.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 333 15 4270503 4270488 801.443 798.25 0.000831068 0.00123591 2024-09-16T03:47:19.206 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.200+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:19.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.212+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b77e6f5:::benchmark_data_smithi138_27857_object2622:head, will try copies on 3,4 2024-09-16T03:47:19.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.212+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:47:19.223 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.216+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:19.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.224+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c63a5a:::benchmark_data_smithi138_27857_object4048:head, will try copies on 0,4 2024-09-16T03:47:19.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.252+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:47:19.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.264+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:19.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.280+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:19.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.280+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:47:19.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.288+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:47:19.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:47:19.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:19.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.344+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:47:19.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.364+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:47:19.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.380+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:47:19.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.388+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:47:19.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:47:19.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.400+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:47:19.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.400+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642c1a85:::benchmark_data_smithi138_27857_object2564:head, will try copies on 3,4 2024-09-16T03:47:19.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.420+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:47:19.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:47:19.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.444+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:19.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.464+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:47:19.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.484+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac3f9c4:::benchmark_data_smithi138_27857_object1464:head, will try copies on 0,4 2024-09-16T03:47:19.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.492+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:47:19.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.492+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:47:19.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:19.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.500+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:19.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.524+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:47:19.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.524+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:19.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.536+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c1be6b:::benchmark_data_smithi138_27857_object3837:head, will try copies on 0,4 2024-09-16T03:47:19.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.544+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a18f16:::benchmark_data_smithi138_27857_object126:head, will try copies on 2,3 2024-09-16T03:47:19.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:47:19.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.572+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b63a85a8:::benchmark_data_smithi138_27857_object4006:head, will try copies on 2,3 2024-09-16T03:47:19.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.576+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:47:19.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.592+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:19.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.620+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:47:19.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.620+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:19.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.628+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:47:19.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:668af413:::benchmark_data_smithi138_27857_object2540:head, will try copies on 3,4 2024-09-16T03:47:19.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:19.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.660+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:47:19.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.680+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:47:19.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.688+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:47:19.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.696+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:47:19.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.696+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:47:19.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.716+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:47:19.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.720+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:47:19.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.732+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:47:19.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.744+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb751ad:::benchmark_data_smithi138_27857_object4014:head, will try copies on 3,4 2024-09-16T03:47:19.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.760+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:47:19.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:47:19.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.788+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ab7617:::benchmark_data_smithi138_27857_object2668:head, will try copies on 0,4 2024-09-16T03:47:19.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.792+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:47:19.818 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.812+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:47:19.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.828+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:47:19.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.832+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:47:19.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ed57d8:::benchmark_data_smithi138_27857_object1503:head, will try copies on 0,4 2024-09-16T03:47:19.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.844+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:47:19.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.864+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:19.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.896+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:47:19.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.896+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9160713:::benchmark_data_smithi138_27857_object2337:head, will try copies on 2,3 2024-09-16T03:47:19.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.900+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:47:19.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.916+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5597405d:::benchmark_data_smithi138_27857_object577:head, will try copies on 3,4 2024-09-16T03:47:19.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.920+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:19.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.960+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb448303:::benchmark_data_smithi138_27857_object3080:head, will try copies on 2,3 2024-09-16T03:47:19.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:47:19.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872ca7b:::benchmark_data_smithi138_27857_object1060:head, will try copies on 0,4 2024-09-16T03:47:19.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:19.992+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:47:20.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:47:20.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.012+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:47:20.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.012+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:47:20.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:47:20.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.036+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:20.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:47:20.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.060+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13fb428:::benchmark_data_smithi138_27857_object669:head, will try copies on 2,3 2024-09-16T03:47:20.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.076+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:47:20.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.080+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:47:20.102 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.096+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebba433:::benchmark_data_smithi138_27857_object1082:head, will try copies on 3,4 2024-09-16T03:47:20.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:47:20.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.116+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:47:20.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.124+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:47:20.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.136+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:47:20.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.140+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:47:20.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.156+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:47:20.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.164+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:47:20.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 334 16 4283450 4283434 801.466 809.125 0.000702748 0.00123588 2024-09-16T03:47:20.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.192+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:47:20.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.196+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:47:20.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.196+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:47:20.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:47:20.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.216+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:47:20.237 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.232+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:47:20.242 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.236+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:47:20.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.252+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:20.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.264+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b121c18c:::benchmark_data_smithi138_27857_object2604:head, will try copies on 2,3 2024-09-16T03:47:20.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.272+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:47:20.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:47:20.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.296+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:47:20.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.296+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:47:20.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.308+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:47:20.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.320+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:20.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.324+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:47:20.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.332+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:47:20.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:47:20.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:47:20.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.364+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:20.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.372+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceb33d6:::benchmark_data_smithi138_27857_object1322:head, will try copies on 0,4 2024-09-16T03:47:20.382 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.376+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:47:20.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.384+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:20.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.404+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:20.416 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.408+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:47:20.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.412+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f404e4:::benchmark_data_smithi138_27857_object334:head, will try copies on 3,4 2024-09-16T03:47:20.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.436+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:47:20.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:47:20.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.452+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:47:20.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.496+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:47:20.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a97988b:::benchmark_data_smithi138_27857_object79:head, will try copies on 0,4 2024-09-16T03:47:20.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.520+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8ee9df:::benchmark_data_smithi138_27857_object3271:head, will try copies on 2,3 2024-09-16T03:47:20.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.528+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c713b5e:::benchmark_data_smithi138_27857_object2819:head, will try copies on 0,4 2024-09-16T03:47:20.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.552+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:20.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.572+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:47:20.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.592+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:20.602 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:47:20.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.600+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:47:20.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.608+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:47:20.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:47:20.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:47:20.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b566afd7:::benchmark_data_smithi138_27857_object547:head, will try copies on 2,3 2024-09-16T03:47:20.659 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.652+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:47:20.667 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.660+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:20.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.664+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:20.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.676+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:47:20.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.676+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a683a2:::benchmark_data_smithi138_27857_object2220:head, will try copies on 3,4 2024-09-16T03:47:20.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:47:20.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:47:20.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.728+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:47:20.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.732+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:47:20.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.752+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a480504:::benchmark_data_smithi138_27857_object3707:head, will try copies on 3,4 2024-09-16T03:47:20.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.752+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:47:20.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.768+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:47:20.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.776+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:47:20.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.776+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:47:20.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:47:20.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.828+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbfe7a5a:::benchmark_data_smithi138_27857_object1736:head, will try copies on 2,3 2024-09-16T03:47:20.840 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.832+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:20.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.840+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:47:20.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.860+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:47:20.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.872+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:47:20.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.880+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:47:20.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.884+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:47:20.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.888+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:47:20.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:47:20.926 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.920+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:20.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.924+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:47:20.931 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.924+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:47:20.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:20.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.948+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:47:20.955 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.952+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:47:20.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.968+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:47:20.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:20.980+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:47:21.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.024+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:47:21.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.024+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5204cc5e:::benchmark_data_smithi138_27857_object1472:head, will try copies on 3,4 2024-09-16T03:47:21.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:47:21.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.036+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:47:21.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.060+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:47:21.075 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.068+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:21.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.072+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:47:21.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.072+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:47:21.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.088+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fc7c16:::benchmark_data_smithi138_27857_object4040:head, will try copies on 3,4 2024-09-16T03:47:21.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.108+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:47:21.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.108+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:47:21.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.108+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:21.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.112+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57d09b78:::benchmark_data_smithi138_27857_object2434:head, will try copies on 3,4 2024-09-16T03:47:21.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.132+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:21.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.172+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:47:21.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 335 15 4296060 4296045 801.426 788.188 0.000723957 0.00123594 2024-09-16T03:47:21.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.192+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:47:21.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.216+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:47:21.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.224+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:47:21.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.240+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc703a9:::benchmark_data_smithi138_27857_object2238:head, will try copies on 3,4 2024-09-16T03:47:21.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.252+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:21.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:47:21.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.256+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:47:21.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.272+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:47:21.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.280+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:21.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.280+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:47:21.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.308+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:47:21.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.312+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:47:21.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.332+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:21.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.344+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bab2d1a:::benchmark_data_smithi138_27857_object899:head, will try copies on 3,4 2024-09-16T03:47:21.368 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.360+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:47:21.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.368+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:21.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.368+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98b2f132:::benchmark_data_smithi138_27857_object3043:head, will try copies on 0,4 2024-09-16T03:47:21.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.400+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:47:21.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d893464:::benchmark_data_smithi138_27857_object1470:head, will try copies on 0,4 2024-09-16T03:47:21.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.432+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:21.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.444+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:47:21.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.464+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d586c00:::benchmark_data_smithi138_27857_object392:head, will try copies on 3,4 2024-09-16T03:47:21.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.488+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:21.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.488+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213baa61:::benchmark_data_smithi138_27857_object566:head, will try copies on 0,4 2024-09-16T03:47:21.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.508+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673d400c:::benchmark_data_smithi138_27857_object1388:head, will try copies on 3,4 2024-09-16T03:47:21.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.520+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:47:21.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.524+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:47:21.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.524+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b696649:::benchmark_data_smithi138_27857_object3759:head, will try copies on 0,4 2024-09-16T03:47:21.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622f8430:::benchmark_data_smithi138_27857_object841:head, will try copies on 3,4 2024-09-16T03:47:21.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.552+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:47:21.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.552+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:47:21.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.564+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c900db2:::benchmark_data_smithi138_27857_object1734:head, will try copies on 3,4 2024-09-16T03:47:21.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.604+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944fa45f:::benchmark_data_smithi138_27857_object2993:head, will try copies on 0,4 2024-09-16T03:47:21.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.604+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:21.612 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.608+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:47:21.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:21.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.628+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:47:21.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.644+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ee53fc7:::benchmark_data_smithi138_27857_object2905:head, will try copies on 3,4 2024-09-16T03:47:21.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.648+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:21.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.672+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:47:21.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.680+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6906398f:::benchmark_data_smithi138_27857_object2857:head, will try copies on 3,4 2024-09-16T03:47:21.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.692+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:21.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.696+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1b8266:::benchmark_data_smithi138_27857_object2869:head, will try copies on 3,4 2024-09-16T03:47:21.714 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.708+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264bb085:::benchmark_data_smithi138_27857_object869:head, will try copies on 0,4 2024-09-16T03:47:21.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.716+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:47:21.726 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.720+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:21.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.740+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:47:21.747 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.740+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:47:21.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.768+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7966a6:::benchmark_data_smithi138_27857_object645:head, will try copies on 0,4 2024-09-16T03:47:21.796 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.792+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:47:21.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.816+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b15995b:::benchmark_data_smithi138_27857_object925:head, will try copies on 3,4 2024-09-16T03:47:21.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.824+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23249c77:::benchmark_data_smithi138_27857_object2568:head, will try copies on 0,4 2024-09-16T03:47:21.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.836+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd827f4b:::benchmark_data_smithi138_27857_object1270:head, will try copies on 2,3 2024-09-16T03:47:21.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:47:21.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.852+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:47:21.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.908+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:47:21.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.912+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:21.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.932+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:47:21.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.936+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:47:21.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:47:21.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:21.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:47:21.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.976+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:21.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:21.992+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:47:22.021 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.016+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265df98b:::benchmark_data_smithi138_27857_object1188:head, will try copies on 0,4 2024-09-16T03:47:22.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.020+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:47:22.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.036+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:22.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.040+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:47:22.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:47:22.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.068+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:47:22.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.076+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:22.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.080+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:22.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:47:22.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.092+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:47:22.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.108+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:47:22.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.124+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a1728f:::benchmark_data_smithi138_27857_object2571:head, will try copies on 0,4 2024-09-16T03:47:22.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.136+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:22.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.144+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:47:22.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.152+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2f0a03:::benchmark_data_smithi138_27857_object1968:head, will try copies on 2,3 2024-09-16T03:47:22.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.176+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0b9ddc:::benchmark_data_smithi138_27857_object2635:head, will try copies on 0,4 2024-09-16T03:47:22.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 336 16 4309110 4309094 801.468 815.562 0.00099423 0.00123588 2024-09-16T03:47:22.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.180+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d45a3:::benchmark_data_smithi138_27857_object496:head, will try copies on 3,4 2024-09-16T03:47:22.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.192+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2389103e:::benchmark_data_smithi138_27857_object1116:head, will try copies on 0,4 2024-09-16T03:47:22.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.204+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:22.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.208+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:22.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.224+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:47:22.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.240+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:47:22.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.248+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:47:22.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bfc3b2a:::benchmark_data_smithi138_27857_object1040:head, will try copies on 3,4 2024-09-16T03:47:22.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:47:22.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98771f4f:::benchmark_data_smithi138_27857_object216:head, will try copies on 0,4 2024-09-16T03:47:22.304 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.300+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:22.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.300+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:22.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:47:22.350 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.344+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:47:22.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.352+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:47:22.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:47:22.384 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.376+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a73517a:::benchmark_data_smithi138_27857_object1166:head, will try copies on 0,4 2024-09-16T03:47:22.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.388+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:22.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.392+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:22.406 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.400+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:47:22.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.408+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafe539b:::benchmark_data_smithi138_27857_object3075:head, will try copies on 2,3 2024-09-16T03:47:22.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.424+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:22.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.440+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:47:22.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.444+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:47:22.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.444+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:22.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.456+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:47:22.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d804360:::benchmark_data_smithi138_27857_object2779:head, will try copies on 3,4 2024-09-16T03:47:22.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.484+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:47:22.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.492+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:47:22.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.496+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:47:22.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.516+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:47:22.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.524+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:47:22.533 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:47:22.542 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.536+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:47:22.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.540+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c36239e:::benchmark_data_smithi138_27857_object1378:head, will try copies on 0,4 2024-09-16T03:47:22.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.556+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:47:22.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.564+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:47:22.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.588+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:47:22.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.600+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:47:22.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.620+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:22.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.636+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b886143e:::benchmark_data_smithi138_27857_object623:head, will try copies on 2,3 2024-09-16T03:47:22.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.648+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:22.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.668+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:22.675 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.668+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:47:22.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:47:22.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.688+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2ea80b:::benchmark_data_smithi138_27857_object1254:head, will try copies on 0,4 2024-09-16T03:47:22.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.696+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:47:22.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.696+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d7290e:::benchmark_data_smithi138_27857_object1488:head, will try copies on 3,4 2024-09-16T03:47:22.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.712+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:47:22.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.732+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:47:22.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.736+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9de479ed:::benchmark_data_smithi138_27857_object1971:head, will try copies on 0,4 2024-09-16T03:47:22.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.756+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f74777:::benchmark_data_smithi138_27857_object85:head, will try copies on 3,4 2024-09-16T03:47:22.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.760+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:22.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.764+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:47:22.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.788+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:22.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.788+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:47:22.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.808+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e34262:::benchmark_data_smithi138_27857_object2649:head, will try copies on 3,4 2024-09-16T03:47:22.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.812+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:47:22.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.824+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:47:22.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.836+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:22.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.840+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:22.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.856+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:47:22.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.884+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:22.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.892+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:47:22.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:22.911 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.904+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:22.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.912+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:47:22.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.932+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:47:22.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.936+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:47:22.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.948+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:22.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.956+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:47:22.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.960+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:47:22.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f21ead9:::benchmark_data_smithi138_27857_object4080:head, will try copies on 0,4 2024-09-16T03:47:23.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:22.996+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:47:23.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a2bbc58:::benchmark_data_smithi138_27857_object1428:head, will try copies on 0,4 2024-09-16T03:47:23.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.028+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:23.041 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.036+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:47:23.050 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.044+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:47:23.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.052+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:47:23.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.060+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:23.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.068+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:47:23.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.080+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa7c360:::benchmark_data_smithi138_27857_object2617:head, will try copies on 3,4 2024-09-16T03:47:23.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a07529:::benchmark_data_smithi138_27857_object227:head, will try copies on 3,4 2024-09-16T03:47:23.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.120+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:23.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.124+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed82975:::benchmark_data_smithi138_27857_object817:head, will try copies on 0,4 2024-09-16T03:47:23.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c5fc0:::benchmark_data_smithi138_27857_object2438:head, will try copies on 3,4 2024-09-16T03:47:23.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.136+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:47:23.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.140+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:23.154 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.148+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:47:23.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.164+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:23.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.172+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57781111:::benchmark_data_smithi138_27857_object291:head, will try copies on 3,4 2024-09-16T03:47:23.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 337 16 4321705 4321689 801.425 787.188 0.000724474 0.00123594 2024-09-16T03:47:23.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.180+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:23.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.192+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:47:23.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.200+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:47:23.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.216+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aece92e:::benchmark_data_smithi138_27857_object3014:head, will try copies on 3,4 2024-09-16T03:47:23.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.224+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:47:23.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.240+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:23.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.244+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:47:23.267 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.260+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557cbfca:::benchmark_data_smithi138_27857_object2935:head, will try copies on 3,4 2024-09-16T03:47:23.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.264+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:47:23.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:47:23.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.276+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523965d8:::benchmark_data_smithi138_27857_object377:head, will try copies on 3,4 2024-09-16T03:47:23.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1777d:::benchmark_data_smithi138_27857_object2705:head, will try copies on 3,4 2024-09-16T03:47:23.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.308+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:47:23.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.316+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd16cf7:::benchmark_data_smithi138_27857_object787:head, will try copies on 3,4 2024-09-16T03:47:23.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.340+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:23.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.356+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ef84e6:::benchmark_data_smithi138_27857_object894:head, will try copies on 2,3 2024-09-16T03:47:23.374 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.368+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:23.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.476+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c9d70a:::benchmark_data_smithi138_27857_object3317:head, will try copies on 0,4 2024-09-16T03:47:23.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.480+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:47:23.492 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:47:23.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.508+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9872df7d:::benchmark_data_smithi138_27857_object1129:head, will try copies on 0,4 2024-09-16T03:47:23.521 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:47:23.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.540+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:23.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:23.566 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.560+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:47:23.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.568+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:47:23.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.580+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b129e375:::benchmark_data_smithi138_27857_object2958:head, will try copies on 2,3 2024-09-16T03:47:23.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.580+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50773608:::benchmark_data_smithi138_27857_object2136:head, will try copies on 3,4 2024-09-16T03:47:23.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.584+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:47:23.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:23.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25196046:::benchmark_data_smithi138_27857_object4060:head, will try copies on 0,4 2024-09-16T03:47:23.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.648+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:23.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.656+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:47:23.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:47:23.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.696+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:47:23.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.700+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:23.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.728+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:47:23.758 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.752+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:47:23.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0f90cb:::benchmark_data_smithi138_27857_object1645:head, will try copies on 2,3 2024-09-16T03:47:23.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.772+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:23.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:47:23.811 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.804+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:23.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.808+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:47:23.834 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.828+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:47:23.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.848+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd7e684e:::benchmark_data_smithi138_27857_object3129:head, will try copies on 2,3 2024-09-16T03:47:23.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d8283d:::benchmark_data_smithi138_27857_object838:head, will try copies on 3,4 2024-09-16T03:47:23.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.884+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:47:23.896 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.892+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba54ea9e:::benchmark_data_smithi138_27857_object283:head, will try copies on 2,3 2024-09-16T03:47:23.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.900+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:47:23.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.900+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:47:23.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.924+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7b8334:::benchmark_data_smithi138_27857_object1640:head, will try copies on 0,4 2024-09-16T03:47:23.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:23.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.944+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f23cba:::benchmark_data_smithi138_27857_object1621:head, will try copies on 3,4 2024-09-16T03:47:23.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:47:23.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.968+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:47:23.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:47:23.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:23.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:23.992+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:47:24.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.004+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d279:::benchmark_data_smithi138_27857_object455:head, will try copies on 3,4 2024-09-16T03:47:24.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.024+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230409d2:::benchmark_data_smithi138_27857_object827:head, will try copies on 0,4 2024-09-16T03:47:24.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.036+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:24.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.052+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:24.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.056+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:47:24.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.076+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:47:24.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.080+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:47:24.097 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.092+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:47:24.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.096+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:47:24.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.108+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2203ecb5:::benchmark_data_smithi138_27857_object1957:head, will try copies on 0,4 2024-09-16T03:47:24.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:47:24.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.132+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:47:24.147 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.140+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:47:24.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.144+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:24.161 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.156+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:24.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.172+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:47:24.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.172+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:47:24.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 338 16 4334949 4334933 801.503 827.75 0.000540347 0.00123582 2024-09-16T03:47:24.192 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.188+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:47:24.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a777de:::benchmark_data_smithi138_27857_object863:head, will try copies on 0,4 2024-09-16T03:47:24.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.200+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5a1077:::benchmark_data_smithi138_27857_object2845:head, will try copies on 0,4 2024-09-16T03:47:24.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.220+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:47:24.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.224+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:24.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.224+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:47:24.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.228+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e936c:::benchmark_data_smithi138_27857_object2579:head, will try copies on 0,4 2024-09-16T03:47:24.243 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.236+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:47:24.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.240+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:47:24.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.244+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb75efbe:::benchmark_data_smithi138_27857_object2694:head, will try copies on 2,3 2024-09-16T03:47:24.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.296+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:47:24.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.296+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:47:24.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:47:24.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.332+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:47:24.339 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.332+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284a0b26:::benchmark_data_smithi138_27857_object3854:head, will try copies on 0,4 2024-09-16T03:47:24.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.336+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:47:24.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.364+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:47:24.371 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.364+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:47:24.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.384+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:24.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.392+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:47:24.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:573e2d96:::benchmark_data_smithi138_27857_object2309:head, will try copies on 3,4 2024-09-16T03:47:24.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.420+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:47:24.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.444+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:24.453 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.448+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:24.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.448+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:47:24.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.476+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:47:24.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.488+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:47:24.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.496+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:47:24.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.512+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:47:24.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.512+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286a0369:::benchmark_data_smithi138_27857_object471:head, will try copies on 0,4 2024-09-16T03:47:24.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.512+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b83f3095:::benchmark_data_smithi138_27857_object777:head, will try copies on 2,3 2024-09-16T03:47:24.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.540+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:47:24.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.540+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:47:24.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.540+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:24.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:47:24.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.564+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:47:24.596 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.592+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:47:24.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.592+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:47:24.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.592+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4a713f:::benchmark_data_smithi138_27857_object2273:head, will try copies on 2,3 2024-09-16T03:47:24.617 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.612+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:24.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.620+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:47:24.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.632+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:47:24.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.632+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:47:24.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.640+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1acc91:::benchmark_data_smithi138_27857_object674:head, will try copies on 3,4 2024-09-16T03:47:24.668 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.664+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52668cd8:::benchmark_data_smithi138_27857_object2123:head, will try copies on 3,4 2024-09-16T03:47:24.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.672+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:47:24.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.672+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:47:24.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.684+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:47:24.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.684+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:47:24.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.688+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:47:24.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.784+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9961b916:::benchmark_data_smithi138_27857_object3212:head, will try copies on 0,4 2024-09-16T03:47:24.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.792+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:47:24.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.792+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b06de162:::benchmark_data_smithi138_27857_object744:head, will try copies on 2,3 2024-09-16T03:47:24.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb47076:::benchmark_data_smithi138_27857_object3314:head, will try copies on 3,4 2024-09-16T03:47:24.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.808+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bbbd5f:::benchmark_data_smithi138_27857_object1418:head, will try copies on 0,4 2024-09-16T03:47:24.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.836+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:47:24.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.848+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5177361f:::benchmark_data_smithi138_27857_object1847:head, will try copies on 3,4 2024-09-16T03:47:24.857 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.852+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:24.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.856+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:47:24.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:24.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.868+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6027137a:::benchmark_data_smithi138_27857_object3744:head, will try copies on 3,4 2024-09-16T03:47:24.874 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.868+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:47:24.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.888+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b14d21d5:::benchmark_data_smithi138_27857_object1402:head, will try copies on 2,3 2024-09-16T03:47:24.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.912+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:24.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.912+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:24.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.928+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:24.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:47:24.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.960+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:47:24.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.964+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:47:24.972 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.968+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fa3e5c:::benchmark_data_smithi138_27857_object3038:head, will try copies on 2,3 2024-09-16T03:47:24.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.976+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e880e8:::benchmark_data_smithi138_27857_object2901:head, will try copies on 3,4 2024-09-16T03:47:24.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:24.992+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:25.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.000+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:25.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:25.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.008+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:47:25.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.020+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d746ee2:::benchmark_data_smithi138_27857_object1260:head, will try copies on 3,4 2024-09-16T03:47:25.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c4281f:::benchmark_data_smithi138_27857_object53:head, will try copies on 0,4 2024-09-16T03:47:25.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.052+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1596ac3:::benchmark_data_smithi138_27857_object3091:head, will try copies on 2,3 2024-09-16T03:47:25.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690524b2:::benchmark_data_smithi138_27857_object2297:head, will try copies on 3,4 2024-09-16T03:47:25.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.064+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:25.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:47:25.082 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.076+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d1ff9ec:::benchmark_data_smithi138_27857_object1813:head, will try copies on 0,4 2024-09-16T03:47:25.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.084+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:47:25.121 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:25.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.120+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:47:25.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.128+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:25.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.148+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:25.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.152+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:25.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.152+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:247f3fc2:::benchmark_data_smithi138_27857_object3346:head, will try copies on 0,4 2024-09-16T03:47:25.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.168+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:25.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 339 16 4346824 4346808 801.328 742.188 0.0011628 0.00123609 2024-09-16T03:47:25.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.180+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:25.191 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.184+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8e5430:::benchmark_data_smithi138_27857_object1085:head, will try copies on 0,4 2024-09-16T03:47:25.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.212+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:47:25.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.220+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f93072:::benchmark_data_smithi138_27857_object2656:head, will try copies on 2,3 2024-09-16T03:47:25.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:47:25.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.240+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:25.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d5b6ee:::benchmark_data_smithi138_27857_object3755:head, will try copies on 0,4 2024-09-16T03:47:25.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.268+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:47:25.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.288+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d2e81a:::benchmark_data_smithi138_27857_object2960:head, will try copies on 2,3 2024-09-16T03:47:25.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:47:25.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:47:25.318 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.312+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:25.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.324+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:47:25.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.332+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:47:25.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:47:25.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.348+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fced25:::benchmark_data_smithi138_27857_object3045:head, will try copies on 2,3 2024-09-16T03:47:25.366 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.360+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:47:25.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.384+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:47:25.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.396+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:47:25.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.400+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980c5bdb:::benchmark_data_smithi138_27857_object860:head, will try copies on 0,4 2024-09-16T03:47:25.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.408+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:25.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.412+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a671da2:::benchmark_data_smithi138_27857_object3831:head, will try copies on 0,4 2024-09-16T03:47:25.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:47:25.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f01fb8:::benchmark_data_smithi138_27857_object110:head, will try copies on 0,4 2024-09-16T03:47:25.435 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.428+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fdc423:::benchmark_data_smithi138_27857_object1280:head, will try copies on 3,4 2024-09-16T03:47:25.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.460+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:47:25.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.472+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:47:25.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.480+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:47:25.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.488+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:47:25.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.488+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:47:25.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.512+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:47:25.541 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.536+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6e5cba:::benchmark_data_smithi138_27857_object3866:head, will try copies on 3,4 2024-09-16T03:47:25.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.540+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7226119:::benchmark_data_smithi138_27857_object1844:head, will try copies on 2,3 2024-09-16T03:47:25.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.544+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:47:25.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.552+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:47:25.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.552+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ada3493:::benchmark_data_smithi138_27857_object644:head, will try copies on 3,4 2024-09-16T03:47:25.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.560+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:47:25.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.576+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:47:25.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.596+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f0f28b:::benchmark_data_smithi138_27857_object1149:head, will try copies on 2,3 2024-09-16T03:47:25.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.600+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:25.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.600+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:47:25.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.648+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:47:25.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.652+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d24292:::benchmark_data_smithi138_27857_object3394:head, will try copies on 0,4 2024-09-16T03:47:25.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.672+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:47:25.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.688+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:25.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.696+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:25.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.716+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:47:25.721 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:47:25.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.728+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:25.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.736+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:47:25.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.748+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:47:25.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.756+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:47:25.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:47:25.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.792+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:47:25.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.804+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:47:25.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:47:25.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.828+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:47:25.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:47:25.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.856+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:47:25.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.884+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:47:25.890 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.884+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:47:25.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.888+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:47:25.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.916+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:47:25.939 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.932+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:47:25.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:47:25.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b55680ef:::benchmark_data_smithi138_27857_object1938:head, will try copies on 2,3 2024-09-16T03:47:25.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.956+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:47:25.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.964+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c015271:::benchmark_data_smithi138_27857_object1451:head, will try copies on 0,4 2024-09-16T03:47:25.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:25.984+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:26.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.000+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:26.024 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff1a5db:::benchmark_data_smithi138_27857_object1997:head, will try copies on 3,4 2024-09-16T03:47:26.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.032+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:47:26.059 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.052+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69801761:::benchmark_data_smithi138_27857_object112:head, will try copies on 3,4 2024-09-16T03:47:26.065 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.060+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e97e3a:::benchmark_data_smithi138_27857_object408:head, will try copies on 0,4 2024-09-16T03:47:26.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991e02ce:::benchmark_data_smithi138_27857_object2343:head, will try copies on 0,4 2024-09-16T03:47:26.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.088+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:47:26.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.092+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:47:26.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.092+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:47:26.105 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.100+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:47:26.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.112+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:26.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.116+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b15c734:::benchmark_data_smithi138_27857_object871:head, will try copies on 0,4 2024-09-16T03:47:26.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.116+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:26.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:26.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.140+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5c96ae7:::benchmark_data_smithi138_27857_object3424:head, will try copies on 2,3 2024-09-16T03:47:26.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.160+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56240fac:::benchmark_data_smithi138_27857_object3450:head, will try copies on 3,4 2024-09-16T03:47:26.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.172+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693761d7:::benchmark_data_smithi138_27857_object420:head, will try copies on 3,4 2024-09-16T03:47:26.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:2024-09-16T03:47:26.186094+0000 min lat: 0.000234761 max lat: 0.141023 avg lat: 0.00123601 2024-09-16T03:47:26.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:47:26.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 340 16 4359936 4359920 801.381 819.5 0.00102447 0.00123601 2024-09-16T03:47:26.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.180+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:26.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.192+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:47:26.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.192+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:47:26.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.200+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:26.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.212+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:26.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.232+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:26.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea506ba:::benchmark_data_smithi138_27857_object1986:head, will try copies on 3,4 2024-09-16T03:47:26.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.252+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:26.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.252+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:47:26.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.296+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:47:26.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.296+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:47:26.311 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efbf6a5:::benchmark_data_smithi138_27857_object2661:head, will try copies on 3,4 2024-09-16T03:47:26.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.332+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:47:26.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.344+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:47:26.351 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.344+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:47:26.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.352+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:26.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.356+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:26.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab8326f:::benchmark_data_smithi138_27857_object2451:head, will try copies on 0,4 2024-09-16T03:47:26.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.400+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58568e41:::benchmark_data_smithi138_27857_object44:head, will try copies on 3,4 2024-09-16T03:47:26.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cecd489:::benchmark_data_smithi138_27857_object299:head, will try copies on 0,4 2024-09-16T03:47:26.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:47:26.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.436+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:47:26.446 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.440+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:47:26.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.452+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ea4f7:::benchmark_data_smithi138_27857_object444:head, will try copies on 0,4 2024-09-16T03:47:26.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.464+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:26.469 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:26.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.480+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5095a557:::benchmark_data_smithi138_27857_object1180:head, will try copies on 3,4 2024-09-16T03:47:26.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.492+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:47:26.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.496+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:47:26.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.528+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ee7129:::benchmark_data_smithi138_27857_object3741:head, will try copies on 0,4 2024-09-16T03:47:26.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:47:26.537 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.532+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:47:26.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.548+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:47:26.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.552+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:26.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.564+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:26.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b7ea7d:::benchmark_data_smithi138_27857_object2352:head, will try copies on 2,3 2024-09-16T03:47:26.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.584+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb0e301:::benchmark_data_smithi138_27857_object3523:head, will try copies on 0,4 2024-09-16T03:47:26.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.588+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:47:26.603 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.596+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:47:26.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.604+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:47:26.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:47:26.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.624+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:47:26.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.640+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:47:26.658 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.652+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ecbf49:::benchmark_data_smithi138_27857_object3119:head, will try copies on 3,4 2024-09-16T03:47:26.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.656+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be947710:::benchmark_data_smithi138_27857_object1350:head, will try copies on 2,3 2024-09-16T03:47:26.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:26.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.692+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:47:26.705 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.700+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca9222b:::benchmark_data_smithi138_27857_object1065:head, will try copies on 0,4 2024-09-16T03:47:26.707 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.700+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:26.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.708+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd582f3e:::benchmark_data_smithi138_27857_object975:head, will try copies on 2,3 2024-09-16T03:47:26.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.720+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:26.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.728+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:47:26.753 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.748+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:47:26.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.752+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:47:26.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.756+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:47:26.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.764+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:47:26.788 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.784+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:47:26.792 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.788+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c16841e:::benchmark_data_smithi138_27857_object1602:head, will try copies on 0,4 2024-09-16T03:47:26.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.788+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:26.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.824+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:47:26.841 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.836+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:47:26.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.856+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:26.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.864+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c5a6ee:::benchmark_data_smithi138_27857_object2080:head, will try copies on 3,4 2024-09-16T03:47:26.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.864+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:47:26.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.880+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:47:26.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:47:26.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.900+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:47:26.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.932+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:26.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.936+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd8f593:::benchmark_data_smithi138_27857_object807:head, will try copies on 2,3 2024-09-16T03:47:26.953 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.948+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:47:26.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.956+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:47:26.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.968+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:26.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.980+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:47:26.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.984+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:47:26.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:26.992+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:27.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:47:27.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:47:27.014 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.008+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb81800:::benchmark_data_smithi138_27857_object1675:head, will try copies on 3,4 2024-09-16T03:47:27.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.040+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:47:27.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.056+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:47:27.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.056+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:47:27.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.084+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:47:27.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.092+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:47:27.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.108+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:27.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.116+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:47:27.128 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.124+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:47:27.132 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.128+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b85b44:::benchmark_data_smithi138_27857_object2020:head, will try copies on 3,4 2024-09-16T03:47:27.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.140+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:47:27.151 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.144+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:27.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.176+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:47:27.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 341 16 4372814 4372798 801.391 804.875 0.00179375 0.001236 2024-09-16T03:47:27.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.180+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630caf67:::benchmark_data_smithi138_27857_object3816:head, will try copies on 3,4 2024-09-16T03:47:27.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.188+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:47:27.195 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.188+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:47:27.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:47:27.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.196+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:47:27.248 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.244+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:27.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.244+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:47:27.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:27.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.288+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:47:27.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc188a4:::benchmark_data_smithi138_27857_object3622:head, will try copies on 0,4 2024-09-16T03:47:27.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.320+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:47:27.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.336+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:47:27.341 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.336+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:47:27.347 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.340+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:27.357 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.352+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93cbc41d:::benchmark_data_smithi138_27857_object561:head, will try copies on 0,4 2024-09-16T03:47:27.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.380+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:47:27.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.388+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2166c7db:::benchmark_data_smithi138_27857_object811:head, will try copies on 0,4 2024-09-16T03:47:27.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:522cc535:::benchmark_data_smithi138_27857_object1577:head, will try copies on 3,4 2024-09-16T03:47:27.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.412+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:47:27.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.440+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:27.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.444+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:47:27.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:27.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:47:27.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.472+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:47:27.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.480+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:47:27.496 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.492+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:47:27.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.512+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e33405:::benchmark_data_smithi138_27857_object3421:head, will try copies on 3,4 2024-09-16T03:47:27.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.516+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:27.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.540+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:27.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.564+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb31fe15:::benchmark_data_smithi138_27857_object3936:head, will try copies on 2,3 2024-09-16T03:47:27.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.568+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:47:27.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.588+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:47:27.609 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.604+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:47:27.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.624+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:47:27.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.624+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:47:27.654 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.648+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:47:27.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.664+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:47:27.677 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.672+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:47:27.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:47:27.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.692+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c760ff0:::benchmark_data_smithi138_27857_object1644:head, will try copies on 0,4 2024-09-16T03:47:27.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.708+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:27.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.740+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:47:27.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.740+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66be0601:::benchmark_data_smithi138_27857_object2323:head, will try copies on 3,4 2024-09-16T03:47:27.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.748+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:27.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.764+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:27.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.768+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:47:27.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.776+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b33a4b:::benchmark_data_smithi138_27857_object2775:head, will try copies on 0,4 2024-09-16T03:47:27.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:47:27.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.788+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:47:27.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.808+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:47:27.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.812+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69507acd:::benchmark_data_smithi138_27857_object3216:head, will try copies on 3,4 2024-09-16T03:47:27.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.812+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:27.830 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.824+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:47:27.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.844+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:47:27.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.856+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:47:27.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.876+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:47:27.893 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:47:27.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.892+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:47:27.900 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.896+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:47:27.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.904+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e46292a:::benchmark_data_smithi138_27857_object4037:head, will try copies on 0,4 2024-09-16T03:47:27.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.928+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a16323:::benchmark_data_smithi138_27857_object3850:head, will try copies on 3,4 2024-09-16T03:47:27.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.936+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:27.952 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.948+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d676f57:::benchmark_data_smithi138_27857_object771:head, will try copies on 3,4 2024-09-16T03:47:27.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.956+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8626ba:::benchmark_data_smithi138_27857_object1985:head, will try copies on 0,4 2024-09-16T03:47:27.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.980+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d32ce5c:::benchmark_data_smithi138_27857_object1877:head, will try copies on 3,4 2024-09-16T03:47:27.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.988+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:47:27.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:27.992+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0c8be3:::benchmark_data_smithi138_27857_object588:head, will try copies on 0,4 2024-09-16T03:47:28.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.008+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:47:28.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.008+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:47:28.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.032+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64169540:::benchmark_data_smithi138_27857_object153:head, will try copies on 3,4 2024-09-16T03:47:28.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:28.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.048+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:47:28.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.080+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:571f0ee1:::benchmark_data_smithi138_27857_object1954:head, will try copies on 3,4 2024-09-16T03:47:28.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.080+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f097fde:::benchmark_data_smithi138_27857_object1313:head, will try copies on 0,4 2024-09-16T03:47:28.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.084+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:47:28.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.112+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:28.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627f845e:::benchmark_data_smithi138_27857_object1421:head, will try copies on 3,4 2024-09-16T03:47:28.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.140+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947029ae:::benchmark_data_smithi138_27857_object3668:head, will try copies on 0,4 2024-09-16T03:47:28.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.152+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:47:28.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.168+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:28.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:47:28.184 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 342 16 4385855 4385839 801.431 815.062 0.000502541 0.00123593 2024-09-16T03:47:28.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.188+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec424ab:::benchmark_data_smithi138_27857_object2426:head, will try copies on 0,4 2024-09-16T03:47:28.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.200+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90b626b2:::benchmark_data_smithi138_27857_object3490:head, will try copies on 0,4 2024-09-16T03:47:28.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff63e19:::benchmark_data_smithi138_27857_object2125:head, will try copies on 2,3 2024-09-16T03:47:28.222 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.216+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:280770f8:::benchmark_data_smithi138_27857_object2128:head, will try copies on 0,4 2024-09-16T03:47:28.227 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.220+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:28.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.224+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:47:28.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.232+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:28.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac072b2:::benchmark_data_smithi138_27857_object2202:head, will try copies on 3,4 2024-09-16T03:47:28.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.276+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3b77a9:::benchmark_data_smithi138_27857_object1090:head, will try copies on 2,3 2024-09-16T03:47:28.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.280+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:47:28.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.280+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:47:28.316 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.312+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:47:28.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.316+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec81693:::benchmark_data_smithi138_27857_object367:head, will try copies on 3,4 2024-09-16T03:47:28.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.348+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:47:28.361 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.356+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adb6ab2:::benchmark_data_smithi138_27857_object1776:head, will try copies on 3,4 2024-09-16T03:47:28.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.360+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:47:28.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:47:28.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.388+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a652396:::benchmark_data_smithi138_27857_object1288:head, will try copies on 3,4 2024-09-16T03:47:28.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.388+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:47:28.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.408+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:47:28.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.424+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52692113:::benchmark_data_smithi138_27857_object3109:head, will try copies on 3,4 2024-09-16T03:47:28.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:47:28.440 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.436+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:47:28.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:28.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.464+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:28.481 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.476+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:28.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.504+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:47:28.519 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.512+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e3cbd49:::benchmark_data_smithi138_27857_object3715:head, will try copies on 0,4 2024-09-16T03:47:28.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:47:28.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.552+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:47:28.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.564+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b429eb:::benchmark_data_smithi138_27857_object304:head, will try copies on 3,4 2024-09-16T03:47:28.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:28.578 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.572+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:47:28.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.576+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:28.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.580+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5ead0a:::benchmark_data_smithi138_27857_object2304:head, will try copies on 0,4 2024-09-16T03:47:28.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.592+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6279173d:::benchmark_data_smithi138_27857_object2243:head, will try copies on 3,4 2024-09-16T03:47:28.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.600+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:28.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b639ba2b:::benchmark_data_smithi138_27857_object3805:head, will try copies on 2,3 2024-09-16T03:47:28.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.640+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:28.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:47:28.650 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21586ca3:::benchmark_data_smithi138_27857_object1961:head, will try copies on 0,4 2024-09-16T03:47:28.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.648+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:47:28.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.668+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ddac177:::benchmark_data_smithi138_27857_object2802:head, will try copies on 3,4 2024-09-16T03:47:28.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.676+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:47:28.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.684+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:28.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.692+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:28.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.704+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a14813:::benchmark_data_smithi138_27857_object3795:head, will try copies on 2,3 2024-09-16T03:47:28.719 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.712+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acfa9f5:::benchmark_data_smithi138_27857_object56:head, will try copies on 0,4 2024-09-16T03:47:28.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.720+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce62f50:::benchmark_data_smithi138_27857_object3696:head, will try copies on 3,4 2024-09-16T03:47:28.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.732+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:47:28.745 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.740+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b76dcc7:::benchmark_data_smithi138_27857_object1548:head, will try copies on 3,4 2024-09-16T03:47:28.772 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.768+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:47:28.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.784+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:28.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.784+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:28.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.788+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:47:28.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.812+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:47:28.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.824+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:47:28.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.828+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507552b0:::benchmark_data_smithi138_27857_object519:head, will try copies on 3,4 2024-09-16T03:47:28.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.832+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:28.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9654c4f3:::benchmark_data_smithi138_27857_object3924:head, will try copies on 0,4 2024-09-16T03:47:28.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.852+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:28.882 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:47:28.889 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.884+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:47:28.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:47:28.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.900+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:47:28.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.908+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c0682af:::benchmark_data_smithi138_27857_object3395:head, will try copies on 3,4 2024-09-16T03:47:28.920 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.916+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:47:28.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.920+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f80c9f:::benchmark_data_smithi138_27857_object3613:head, will try copies on 3,4 2024-09-16T03:47:28.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.944+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0892d4:::benchmark_data_smithi138_27857_object27:head, will try copies on 3,4 2024-09-16T03:47:28.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.944+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f2eb3b:::benchmark_data_smithi138_27857_object3487:head, will try copies on 0,4 2024-09-16T03:47:28.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.952+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:28.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.956+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:47:28.966 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.960+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8d036d:::benchmark_data_smithi138_27857_object2548:head, will try copies on 3,4 2024-09-16T03:47:28.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.980+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:47:28.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:28.988+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:47:29.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.004+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950ea01f:::benchmark_data_smithi138_27857_object446:head, will try copies on 0,4 2024-09-16T03:47:29.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.012+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6102c8:::benchmark_data_smithi138_27857_object2052:head, will try copies on 0,4 2024-09-16T03:47:29.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.036+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6249f295:::benchmark_data_smithi138_27857_object218:head, will try copies on 3,4 2024-09-16T03:47:29.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.048+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:47:29.057 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.052+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:29.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65368993:::benchmark_data_smithi138_27857_object2750:head, will try copies on 3,4 2024-09-16T03:47:29.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.068+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be65926:::benchmark_data_smithi138_27857_object2743:head, will try copies on 0,4 2024-09-16T03:47:29.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b994b8:::benchmark_data_smithi138_27857_object1259:head, will try copies on 0,4 2024-09-16T03:47:29.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.076+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:29.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.076+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:47:29.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:227c2218:::benchmark_data_smithi138_27857_object4100:head, will try copies on 0,4 2024-09-16T03:47:29.130 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.124+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:29.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.128+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:47:29.145 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.140+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb383498:::benchmark_data_smithi138_27857_object892:head, will try copies on 2,3 2024-09-16T03:47:29.150 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.144+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:47:29.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.160+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc433296:::benchmark_data_smithi138_27857_object1298:head, will try copies on 2,3 2024-09-16T03:47:29.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.164+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:47:29.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 343 16 4398341 4398325 801.369 780.375 0.000763594 0.00123603 2024-09-16T03:47:29.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.180+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:47:29.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.188+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c59ac9:::benchmark_data_smithi138_27857_object952:head, will try copies on 2,3 2024-09-16T03:47:29.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.208+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:47:29.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.232+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:29.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.232+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:47:29.251 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.244+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:29.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.252+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:29.278 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.272+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:29.285 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.280+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:29.288 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.284+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:29.327 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.320+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:47:29.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.324+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:47:29.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.340+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b869fe1:::benchmark_data_smithi138_27857_object970:head, will try copies on 3,4 2024-09-16T03:47:29.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.352+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:29.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.360+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:47:29.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.368+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d7d87c3:::benchmark_data_smithi138_27857_object3322:head, will try copies on 0,4 2024-09-16T03:47:29.392 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.388+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:29.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.400+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:47:29.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.404+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54992c0b:::benchmark_data_smithi138_27857_object1253:head, will try copies on 3,4 2024-09-16T03:47:29.422 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.416+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:47:29.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.420+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:47:29.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.420+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:29.436 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.432+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:47:29.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.476+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:47:29.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.496+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:47:29.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.524+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:47:29.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.568+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:47:29.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.584+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:29.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.640+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:47:29.666 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.660+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d71f830:::benchmark_data_smithi138_27857_object1086:head, will try copies on 3,4 2024-09-16T03:47:29.692 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.688+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:258bc996:::benchmark_data_smithi138_27857_object1940:head, will try copies on 0,4 2024-09-16T03:47:29.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.700+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:29.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.708+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:29.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.724+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:29.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.736+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:47:29.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.744+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:47:29.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.752+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:47:29.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.768+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:29.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.772+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d91f7e9:::benchmark_data_smithi138_27857_object1804:head, will try copies on 0,4 2024-09-16T03:47:29.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.784+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d37467:::benchmark_data_smithi138_27857_object3294:head, will try copies on 3,4 2024-09-16T03:47:29.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.784+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:47:29.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.812+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23725b0d:::benchmark_data_smithi138_27857_object2475:head, will try copies on 0,4 2024-09-16T03:47:29.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.828+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:29.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.848+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:47:29.855 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.852+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2412791a:::benchmark_data_smithi138_27857_object3228:head, will try copies on 0,4 2024-09-16T03:47:29.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906c1f0e:::benchmark_data_smithi138_27857_object3391:head, will try copies on 0,4 2024-09-16T03:47:29.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:47:29.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.896+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:29.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.908+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:29.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.912+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:29.923 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.916+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62213e5:::benchmark_data_smithi138_27857_object3890:head, will try copies on 2,3 2024-09-16T03:47:29.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.936+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:47:29.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.960+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976785d2:::benchmark_data_smithi138_27857_object2314:head, will try copies on 0,4 2024-09-16T03:47:29.982 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.976+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:47:29.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9863ab4d:::benchmark_data_smithi138_27857_object3901:head, will try copies on 0,4 2024-09-16T03:47:29.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.984+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:47:29.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:29.992+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:47:30.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.000+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6fdfa4:::benchmark_data_smithi138_27857_object258:head, will try copies on 3,4 2024-09-16T03:47:30.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.016+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:511b77f3:::benchmark_data_smithi138_27857_object1375:head, will try copies on 3,4 2024-09-16T03:47:30.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.044+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:30.064 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:47:30.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.080+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915c24c3:::benchmark_data_smithi138_27857_object689:head, will try copies on 0,4 2024-09-16T03:47:30.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.100+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:47:30.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52de023f:::benchmark_data_smithi138_27857_object130:head, will try copies on 3,4 2024-09-16T03:47:30.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67fe0d09:::benchmark_data_smithi138_27857_object448:head, will try copies on 3,4 2024-09-16T03:47:30.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.116+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90ce1bc4:::benchmark_data_smithi138_27857_object3513:head, will try copies on 0,4 2024-09-16T03:47:30.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.120+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc1f0fa:::benchmark_data_smithi138_27857_object890:head, will try copies on 0,4 2024-09-16T03:47:30.167 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.160+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6e314c:::benchmark_data_smithi138_27857_object4036:head, will try copies on 3,4 2024-09-16T03:47:30.177 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:47:30.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.176+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:47:30.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 344 16 4409041 4409025 800.984 668.75 0.00100778 0.00123663 2024-09-16T03:47:30.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.192+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6bbcaee:::benchmark_data_smithi138_27857_object2514:head, will try copies on 2,3 2024-09-16T03:47:30.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.192+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:909fae7a:::benchmark_data_smithi138_27857_object3522:head, will try copies on 0,4 2024-09-16T03:47:30.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.208+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:47:30.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.208+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:30.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.224+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:47:30.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.228+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:30.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.252+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a3a917:::benchmark_data_smithi138_27857_object643:head, will try copies on 0,4 2024-09-16T03:47:30.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.256+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:47:30.263 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.256+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:30.270 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.264+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:47:30.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.280+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2478843a:::benchmark_data_smithi138_27857_object492:head, will try copies on 0,4 2024-09-16T03:47:30.292 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.288+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:47:30.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.288+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:30.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.288+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:47:30.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.324+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:47:30.332 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.328+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976c4cfb:::benchmark_data_smithi138_27857_object243:head, will try copies on 0,4 2024-09-16T03:47:30.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.388+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e38339:::benchmark_data_smithi138_27857_object2874:head, will try copies on 3,4 2024-09-16T03:47:30.410 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.404+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:47:30.412 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.408+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:47:30.427 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.420+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:30.451 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c922d9:::benchmark_data_smithi138_27857_object2499:head, will try copies on 2,3 2024-09-16T03:47:30.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.472+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:47:30.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.484+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:30.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b173a1eb:::benchmark_data_smithi138_27857_object3806:head, will try copies on 2,3 2024-09-16T03:47:30.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.504+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c94d0f4:::benchmark_data_smithi138_27857_object391:head, will try copies on 0,4 2024-09-16T03:47:30.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.528+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d76b1ec:::benchmark_data_smithi138_27857_object3225:head, will try copies on 0,4 2024-09-16T03:47:30.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.548+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c73932:::benchmark_data_smithi138_27857_object3858:head, will try copies on 0,4 2024-09-16T03:47:30.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:47:30.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:948a7b9f:::benchmark_data_smithi138_27857_object1344:head, will try copies on 0,4 2024-09-16T03:47:30.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.592+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:47:30.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:47:30.635 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.628+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:47:30.638 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.632+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:30.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.656+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9532b39e:::benchmark_data_smithi138_27857_object2279:head, will try copies on 0,4 2024-09-16T03:47:30.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.676+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:30.681 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:47:30.682 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.676+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6782e0e1:::benchmark_data_smithi138_27857_object528:head, will try copies on 3,4 2024-09-16T03:47:30.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.692+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:47:30.699 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.692+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:47:30.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.712+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:30.728 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.724+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:47:30.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.728+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be140e28:::benchmark_data_smithi138_27857_object2399:head, will try copies on 2,3 2024-09-16T03:47:30.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.732+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:47:30.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.736+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67603f8c:::benchmark_data_smithi138_27857_object234:head, will try copies on 3,4 2024-09-16T03:47:30.781 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.776+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9819b780:::benchmark_data_smithi138_27857_object3333:head, will try copies on 0,4 2024-09-16T03:47:30.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.784+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:47:30.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.792+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:47:30.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.796+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce7b563:::benchmark_data_smithi138_27857_object2356:head, will try copies on 2,3 2024-09-16T03:47:30.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.796+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:47:30.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.808+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f6fcf1:::benchmark_data_smithi138_27857_object680:head, will try copies on 2,3 2024-09-16T03:47:30.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.848+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd6b7aa:::benchmark_data_smithi138_27857_object940:head, will try copies on 0,4 2024-09-16T03:47:30.862 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.856+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:30.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.856+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:47:30.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.868+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:47:30.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.876+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd3ef6b:::benchmark_data_smithi138_27857_object3348:head, will try copies on 3,4 2024-09-16T03:47:30.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.884+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:30.914 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.908+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:47:30.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.916+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:47:30.930 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.924+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fe6022:::benchmark_data_smithi138_27857_object2566:head, will try copies on 3,4 2024-09-16T03:47:30.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.936+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8ee85:::benchmark_data_smithi138_27857_object874:head, will try copies on 2,3 2024-09-16T03:47:30.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.956+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693f767f:::benchmark_data_smithi138_27857_object3995:head, will try copies on 3,4 2024-09-16T03:47:30.964 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.960+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:30.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.964+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02b1e:::benchmark_data_smithi138_27857_object1279:head, will try copies on 2,3 2024-09-16T03:47:30.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.980+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:31.001 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.996+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2270e07:::benchmark_data_smithi138_27857_object513:head, will try copies on 2,3 2024-09-16T03:47:31.002 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:30.996+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:47:31.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.012+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:47:31.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.016+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8803cb6:::benchmark_data_smithi138_27857_object3789:head, will try copies on 2,3 2024-09-16T03:47:31.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.024+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b23b05:::benchmark_data_smithi138_27857_object2117:head, will try copies on 3,4 2024-09-16T03:47:31.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.036+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:31.047 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.040+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:47:31.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.056+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e976e1:::benchmark_data_smithi138_27857_object1894:head, will try copies on 0,4 2024-09-16T03:47:31.067 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.060+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:31.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.092+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdd933c:::benchmark_data_smithi138_27857_object1266:head, will try copies on 3,4 2024-09-16T03:47:31.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.092+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:47:31.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.096+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21d2db9:::benchmark_data_smithi138_27857_object3617:head, will try copies on 2,3 2024-09-16T03:47:31.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:47:31.124 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.120+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95ee1bc5:::benchmark_data_smithi138_27857_object2997:head, will try copies on 0,4 2024-09-16T03:47:31.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.124+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:31.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2d696e:::benchmark_data_smithi138_27857_object3698:head, will try copies on 3,4 2024-09-16T03:47:31.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.136+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:47:31.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.148+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:47:31.153 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.148+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56862c6e:::benchmark_data_smithi138_27857_object3958:head, will try copies on 3,4 2024-09-16T03:47:31.184 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.180+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:47:31.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 345 15 4421957 4421942 801.002 807.312 0.0011949 0.00123659 2024-09-16T03:47:31.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.196+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:31.205 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.200+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:47:31.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.208+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5409e124:::benchmark_data_smithi138_27857_object3287:head, will try copies on 3,4 2024-09-16T03:47:31.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:31.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.228+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278a47a3:::benchmark_data_smithi138_27857_object3507:head, will try copies on 0,4 2024-09-16T03:47:31.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.240+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:31.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.240+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:31.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.252+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:47:31.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.264+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:47:31.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:47:31.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.276+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264e7e21:::benchmark_data_smithi138_27857_object3337:head, will try copies on 0,4 2024-09-16T03:47:31.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.280+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:47:31.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.292+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:47:31.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.304+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:47:31.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.312+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:31.337 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.332+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:47:31.348 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.344+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1bcc7eb:::benchmark_data_smithi138_27857_object302:head, will try copies on 2,3 2024-09-16T03:47:31.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.368+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd6fcb:::benchmark_data_smithi138_27857_object378:head, will try copies on 3,4 2024-09-16T03:47:31.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.384+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:47:31.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.384+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6156fb:::benchmark_data_smithi138_27857_object709:head, will try copies on 0,4 2024-09-16T03:47:31.393 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.388+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bafb85f6:::benchmark_data_smithi138_27857_object2114:head, will try copies on 2,3 2024-09-16T03:47:31.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.396+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:31.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.404+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cf7418:::benchmark_data_smithi138_27857_object1855:head, will try copies on 3,4 2024-09-16T03:47:31.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.404+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6268a43c:::benchmark_data_smithi138_27857_object1373:head, will try copies on 3,4 2024-09-16T03:47:31.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:47:31.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.456+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:31.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.464+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:31.477 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.472+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:624e1e67:::benchmark_data_smithi138_27857_object2479:head, will try copies on 3,4 2024-09-16T03:47:31.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.472+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:47:31.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.476+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:553f9611:::benchmark_data_smithi138_27857_object127:head, will try copies on 3,4 2024-09-16T03:47:31.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.488+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91947e82:::benchmark_data_smithi138_27857_object2096:head, will try copies on 0,4 2024-09-16T03:47:31.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.500+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:31.515 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.508+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0e1a50e:::benchmark_data_smithi138_27857_object4065:head, will try copies on 2,3 2024-09-16T03:47:31.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.520+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed51e15:::benchmark_data_smithi138_27857_object195:head, will try copies on 3,4 2024-09-16T03:47:31.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.528+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:31.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.540+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74254c0:::benchmark_data_smithi138_27857_object248:head, will try copies on 2,3 2024-09-16T03:47:31.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.544+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:47:31.563 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.556+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dbe979f:::benchmark_data_smithi138_27857_object2154:head, will try copies on 0,4 2024-09-16T03:47:31.573 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.568+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:47:31.581 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:47:31.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.580+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfbca2d6:::benchmark_data_smithi138_27857_object2895:head, will try copies on 2,3 2024-09-16T03:47:31.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.604+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2488c423:::benchmark_data_smithi138_27857_object895:head, will try copies on 0,4 2024-09-16T03:47:31.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.624+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6250a61b:::benchmark_data_smithi138_27857_object1093:head, will try copies on 3,4 2024-09-16T03:47:31.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.636+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a62a393:::benchmark_data_smithi138_27857_object3738:head, will try copies on 3,4 2024-09-16T03:47:31.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.640+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce3b08:::benchmark_data_smithi138_27857_object676:head, will try copies on 2,3 2024-09-16T03:47:31.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:47:31.665 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.660+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289f997c:::benchmark_data_smithi138_27857_object1687:head, will try copies on 0,4 2024-09-16T03:47:31.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.672+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:47:31.684 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.680+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b731052:::benchmark_data_smithi138_27857_object1564:head, will try copies on 3,4 2024-09-16T03:47:31.711 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.704+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baed496b:::benchmark_data_smithi138_27857_object1516:head, will try copies on 2,3 2024-09-16T03:47:31.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.716+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:47:31.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca4c0ed:::benchmark_data_smithi138_27857_object486:head, will try copies on 3,4 2024-09-16T03:47:31.746 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.740+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944e88d4:::benchmark_data_smithi138_27857_object3380:head, will try copies on 0,4 2024-09-16T03:47:31.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.744+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b823734b:::benchmark_data_smithi138_27857_object4114:head, will try copies on 2,3 2024-09-16T03:47:31.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.748+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a0d080e:::benchmark_data_smithi138_27857_object2358:head, will try copies on 3,4 2024-09-16T03:47:31.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.772+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:47:31.795 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.788+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:47:31.812 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.808+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:47:31.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa886d:::benchmark_data_smithi138_27857_object3673:head, will try copies on 3,4 2024-09-16T03:47:31.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.824+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:47:31.833 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.828+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:31.836 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.832+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cfdea1:::benchmark_data_smithi138_27857_object1921:head, will try copies on 3,4 2024-09-16T03:47:31.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.836+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:31.856 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.852+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65126e08:::benchmark_data_smithi138_27857_object1965:head, will try copies on 3,4 2024-09-16T03:47:31.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.860+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:47:31.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.872+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:47:31.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.880+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:975c2be5:::benchmark_data_smithi138_27857_object569:head, will try copies on 0,4 2024-09-16T03:47:31.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.888+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:31.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.896+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:47:31.918 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.912+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:47:31.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.928+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:31.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.940+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eace4e8:::benchmark_data_smithi138_27857_object3493:head, will try copies on 0,4 2024-09-16T03:47:31.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.940+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b043c55d:::benchmark_data_smithi138_27857_object2144:head, will try copies on 2,3 2024-09-16T03:47:31.961 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.956+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:47:31.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.960+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:47:31.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:47:31.985 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:31.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:32.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.000+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:32.027 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.020+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5e49290:::benchmark_data_smithi138_27857_object3935:head, will try copies on 2,3 2024-09-16T03:47:32.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:47:32.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.028+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:47:32.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.036+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:47:32.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.068+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95893d31:::benchmark_data_smithi138_27857_object3340:head, will try copies on 0,4 2024-09-16T03:47:32.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.088+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:47:32.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:47:32.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:47:32.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.104+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:32.131 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.124+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eb0fc0c:::benchmark_data_smithi138_27857_object986:head, will try copies on 3,4 2024-09-16T03:47:32.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.136+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f0e885:::benchmark_data_smithi138_27857_object832:head, will try copies on 3,4 2024-09-16T03:47:32.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.152+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a3185f:::benchmark_data_smithi138_27857_object25:head, will try copies on 0,4 2024-09-16T03:47:32.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.160+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:32.166 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.160+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:32.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 346 16 4434587 4434571 800.968 789.312 0.000583574 0.00123664 2024-09-16T03:47:32.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.180+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:47:32.213 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.208+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:47:32.214 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950b0dcf:::benchmark_data_smithi138_27857_object257:head, will try copies on 0,4 2024-09-16T03:47:32.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:32.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.252+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:47:32.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.252+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:47:32.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:47:32.290 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.284+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:47:32.301 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.296+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:32.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.296+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:47:32.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.300+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94f81f:::benchmark_data_smithi138_27857_object1445:head, will try copies on 2,3 2024-09-16T03:47:32.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.316+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:47:32.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.332+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a840e85:::benchmark_data_smithi138_27857_object2644:head, will try copies on 0,4 2024-09-16T03:47:32.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.352+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af2f1e:::benchmark_data_smithi138_27857_object2346:head, will try copies on 0,4 2024-09-16T03:47:32.390 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.384+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26e6b375:::benchmark_data_smithi138_27857_object3183:head, will try copies on 0,4 2024-09-16T03:47:32.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ad81ae:::benchmark_data_smithi138_27857_object3460:head, will try copies on 3,4 2024-09-16T03:47:32.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.428+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:47:32.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.444+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eb94e1:::benchmark_data_smithi138_27857_object1893:head, will try copies on 3,4 2024-09-16T03:47:32.461 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.456+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6092d534:::benchmark_data_smithi138_27857_object3691:head, will try copies on 3,4 2024-09-16T03:47:32.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:47:32.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.464+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:47:32.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:32.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.500+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:47:32.505 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.500+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ddc0e20:::benchmark_data_smithi138_27857_object1599:head, will try copies on 0,4 2024-09-16T03:47:32.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.512+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:47:32.520 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.516+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20267cae:::benchmark_data_smithi138_27857_object2574:head, will try copies on 0,4 2024-09-16T03:47:32.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.536+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:47:32.544 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.540+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b439b46:::benchmark_data_smithi138_27857_object3022:head, will try copies on 0,4 2024-09-16T03:47:32.550 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:47:32.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.556+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:47:32.577 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.572+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d74252:::benchmark_data_smithi138_27857_object277:head, will try copies on 3,4 2024-09-16T03:47:32.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.584+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a7d597c:::benchmark_data_smithi138_27857_object88:head, will try copies on 0,4 2024-09-16T03:47:32.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.592+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:47:32.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.596+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6a8be7f:::benchmark_data_smithi138_27857_object2573:head, will try copies on 2,3 2024-09-16T03:47:32.611 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.604+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:32.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.620+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:47:32.633 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.628+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3307ef3:::benchmark_data_smithi138_27857_object603:head, will try copies on 2,3 2024-09-16T03:47:32.640 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.636+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f6c9b2e:::benchmark_data_smithi138_27857_object1917:head, will try copies on 3,4 2024-09-16T03:47:32.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.640+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:47:32.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.644+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b101f3:::benchmark_data_smithi138_27857_object4058:head, will try copies on 0,4 2024-09-16T03:47:32.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.684+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:47:32.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.712+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:32.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.724+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:32.733 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.728+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b8cb1:::benchmark_data_smithi138_27857_object2237:head, will try copies on 3,4 2024-09-16T03:47:32.749 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.744+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5538e4:::benchmark_data_smithi138_27857_object1879:head, will try copies on 0,4 2024-09-16T03:47:32.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.748+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:47:32.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.752+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9add4333:::benchmark_data_smithi138_27857_object3057:head, will try copies on 0,4 2024-09-16T03:47:32.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.772+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75ff864:::benchmark_data_smithi138_27857_object3211:head, will try copies on 2,3 2024-09-16T03:47:32.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.780+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65034b00:::benchmark_data_smithi138_27857_object4051:head, will try copies on 3,4 2024-09-16T03:47:32.806 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.800+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:47:32.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.804+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:47:32.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.812+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:32.846 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.840+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309645e:::benchmark_data_smithi138_27857_object3842:head, will try copies on 3,4 2024-09-16T03:47:32.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.848+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:47:32.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.856+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:47:32.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.860+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:47:32.873 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.868+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:47:32.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.872+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58287d96:::benchmark_data_smithi138_27857_object1626:head, will try copies on 3,4 2024-09-16T03:47:32.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.888+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:32.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.888+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:32.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.904+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:47:32.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.936+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:32.944 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:208c6e60:::benchmark_data_smithi138_27857_object2522:head, will try copies on 0,4 2024-09-16T03:47:32.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ca2524:::benchmark_data_smithi138_27857_object891:head, will try copies on 3,4 2024-09-16T03:47:32.948 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.944+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:32.956 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.952+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:47:32.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.972+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:47:32.995 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.988+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:47:33.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:32.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b870c68e:::benchmark_data_smithi138_27857_object1251:head, will try copies on 2,3 2024-09-16T03:47:33.007 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.000+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535ad5a1:::benchmark_data_smithi138_27857_object1874:head, will try copies on 3,4 2024-09-16T03:47:33.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652db67b:::benchmark_data_smithi138_27857_object1262:head, will try copies on 3,4 2024-09-16T03:47:33.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.012+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:47:33.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.028+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:47:33.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.040+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221323d0:::benchmark_data_smithi138_27857_object1583:head, will try copies on 0,4 2024-09-16T03:47:33.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:33.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.068+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:47:33.074 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:47:33.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.084+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:47:33.096 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.092+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:47:33.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.096+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:33.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:33.119 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:33.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.136+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cde3a62:::benchmark_data_smithi138_27857_object1128:head, will try copies on 3,4 2024-09-16T03:47:33.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.148+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:47:33.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.148+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb8f019:::benchmark_data_smithi138_27857_object3214:head, will try copies on 3,4 2024-09-16T03:47:33.175 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:47:33.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 347 16 4447348 4447332 800.958 797.562 0.00105728 0.00123667 2024-09-16T03:47:33.187 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.180+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:33.198 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.192+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:33.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.196+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27768461:::benchmark_data_smithi138_27857_object1307:head, will try copies on 0,4 2024-09-16T03:47:33.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.212+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62936bc:::benchmark_data_smithi138_27857_object215:head, will try copies on 2,3 2024-09-16T03:47:33.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.220+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:47:33.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.240+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d5f0:::benchmark_data_smithi138_27857_object965:head, will try copies on 2,3 2024-09-16T03:47:33.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.240+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:47:33.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.240+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:47:33.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.256+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650725fb:::benchmark_data_smithi138_27857_object3223:head, will try copies on 3,4 2024-09-16T03:47:33.286 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.280+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:47:33.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.280+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9de184d:::benchmark_data_smithi138_27857_object825:head, will try copies on 2,3 2024-09-16T03:47:33.313 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.308+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2326bf85:::benchmark_data_smithi138_27857_object1760:head, will try copies on 0,4 2024-09-16T03:47:33.325 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:47:33.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.324+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:47:33.336 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.328+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9991e6a8:::benchmark_data_smithi138_27857_object574:head, will try copies on 0,4 2024-09-16T03:47:33.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.352+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566193fb:::benchmark_data_smithi138_27857_object191:head, will try copies on 3,4 2024-09-16T03:47:33.362 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.356+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:47:33.376 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.372+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:47:33.377 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.372+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:47:33.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.376+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e293cc:::benchmark_data_smithi138_27857_object649:head, will try copies on 0,4 2024-09-16T03:47:33.411 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.404+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af57807:::benchmark_data_smithi138_27857_object1195:head, will try copies on 0,4 2024-09-16T03:47:33.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.420+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:33.426 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.420+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b5005a0:::benchmark_data_smithi138_27857_object1955:head, will try copies on 3,4 2024-09-16T03:47:33.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.424+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbcab1:::benchmark_data_smithi138_27857_object1172:head, will try copies on 0,4 2024-09-16T03:47:33.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.428+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:33.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.448+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:47:33.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.452+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:33.473 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:47:33.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.480+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc614e:::benchmark_data_smithi138_27857_object1071:head, will try copies on 3,4 2024-09-16T03:47:33.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.484+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:33.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.504+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:47:33.532 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.528+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:47:33.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.528+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:47:33.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.556+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635202cf:::benchmark_data_smithi138_27857_object83:head, will try copies on 3,4 2024-09-16T03:47:33.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8becd6:::benchmark_data_smithi138_27857_object1130:head, will try copies on 0,4 2024-09-16T03:47:33.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.576+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:33.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd07664:::benchmark_data_smithi138_27857_object3494:head, will try copies on 0,4 2024-09-16T03:47:33.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.580+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:47:33.597 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.592+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:47:33.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.632+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299b5f14:::benchmark_data_smithi138_27857_object2296:head, will try copies on 0,4 2024-09-16T03:47:33.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.672+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:619dd658:::benchmark_data_smithi138_27857_object2808:head, will try copies on 3,4 2024-09-16T03:47:33.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.680+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:33.693 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.688+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe17f1b:::benchmark_data_smithi138_27857_object554:head, will try copies on 2,3 2024-09-16T03:47:33.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.712+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:47:33.732 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.728+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:33.736 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.732+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:299680e9:::benchmark_data_smithi138_27857_object1185:head, will try copies on 0,4 2024-09-16T03:47:33.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.752+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9038334e:::benchmark_data_smithi138_27857_object2193:head, will try copies on 0,4 2024-09-16T03:47:33.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.768+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55fed88f:::benchmark_data_smithi138_27857_object3048:head, will try copies on 3,4 2024-09-16T03:47:33.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.768+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9daf7499:::benchmark_data_smithi138_27857_object872:head, will try copies on 0,4 2024-09-16T03:47:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:47:33.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.784+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:47:33.798 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.792+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9367eeae:::benchmark_data_smithi138_27857_object3196:head, will try copies on 0,4 2024-09-16T03:47:33.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60e73827:::benchmark_data_smithi138_27857_object1552:head, will try copies on 3,4 2024-09-16T03:47:33.819 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.812+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:47:33.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.816+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1531706:::benchmark_data_smithi138_27857_object749:head, will try copies on 2,3 2024-09-16T03:47:33.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.840+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345896:::benchmark_data_smithi138_27857_object3412:head, will try copies on 3,4 2024-09-16T03:47:33.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.856+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dd2563:::benchmark_data_smithi138_27857_object2178:head, will try copies on 0,4 2024-09-16T03:47:33.877 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.872+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:47:33.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.880+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:47:33.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:33.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.900+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:47:33.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.924+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:33.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.928+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60299007:::benchmark_data_smithi138_27857_object2389:head, will try copies on 3,4 2024-09-16T03:47:33.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.928+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcbf304c:::benchmark_data_smithi138_27857_object1404:head, will try copies on 2,3 2024-09-16T03:47:33.945 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.940+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5926ad44:::benchmark_data_smithi138_27857_object1211:head, will try copies on 3,4 2024-09-16T03:47:33.992 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.988+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:47:33.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:33.992+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a93cb68:::benchmark_data_smithi138_27857_object1341:head, will try copies on 3,4 2024-09-16T03:47:34.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.004+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c1ffca:::benchmark_data_smithi138_27857_object657:head, will try copies on 3,4 2024-09-16T03:47:34.033 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.028+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27b45cb5:::benchmark_data_smithi138_27857_object284:head, will try copies on 0,4 2024-09-16T03:47:34.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.028+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:47:34.048 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.044+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:34.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.044+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f31a9a2:::benchmark_data_smithi138_27857_object2532:head, will try copies on 3,4 2024-09-16T03:47:34.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.072+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:34.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.080+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:47:34.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.084+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:47:34.099 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.092+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2016b90:::benchmark_data_smithi138_27857_object1069:head, will try copies on 2,3 2024-09-16T03:47:34.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:34.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.108+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:47:34.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2b5f27:::benchmark_data_smithi138_27857_object3303:head, will try copies on 3,4 2024-09-16T03:47:34.137 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.132+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b69ab28:::benchmark_data_smithi138_27857_object2677:head, will try copies on 0,4 2024-09-16T03:47:34.144 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.140+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:47:34.168 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.164+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:47:34.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.176+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:47:34.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.176+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:47:34.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 348 16 4460320 4460304 800.986 810.75 0.000765125 0.00123662 2024-09-16T03:47:34.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.192+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:47:34.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.200+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f3fc2d:::benchmark_data_smithi138_27857_object3604:head, will try copies on 2,3 2024-09-16T03:47:34.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.212+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ea673c4:::benchmark_data_smithi138_27857_object3015:head, will try copies on 0,4 2024-09-16T03:47:34.231 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.224+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbbdcf:::benchmark_data_smithi138_27857_object1120:head, will try copies on 3,4 2024-09-16T03:47:34.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.228+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cacc971:::benchmark_data_smithi138_27857_object3925:head, will try copies on 0,4 2024-09-16T03:47:34.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.256+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3306c8:::benchmark_data_smithi138_27857_object4122:head, will try copies on 0,4 2024-09-16T03:47:34.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.256+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:529f6888:::benchmark_data_smithi138_27857_object2654:head, will try copies on 3,4 2024-09-16T03:47:34.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.268+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6314449:::benchmark_data_smithi138_27857_object3865:head, will try copies on 2,3 2024-09-16T03:47:34.277 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.272+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc37d58:::benchmark_data_smithi138_27857_object541:head, will try copies on 3,4 2024-09-16T03:47:34.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:34.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.292+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:34.298 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512ba0ce:::benchmark_data_smithi138_27857_object2305:head, will try copies on 3,4 2024-09-16T03:47:34.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.308+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67744723:::benchmark_data_smithi138_27857_object3255:head, will try copies on 3,4 2024-09-16T03:47:34.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.328+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba81127b:::benchmark_data_smithi138_27857_object1286:head, will try copies on 2,3 2024-09-16T03:47:34.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.328+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:47:34.349 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.344+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:47:34.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.368+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:34.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.376+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49a3e81:::benchmark_data_smithi138_27857_object1258:head, will try copies on 2,3 2024-09-16T03:47:34.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.388+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:47:34.413 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.408+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:47:34.430 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.424+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:47:34.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.432+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:47:34.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.440+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:34.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.444+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:47:34.450 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.444+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59086372:::benchmark_data_smithi138_27857_object2923:head, will try copies on 3,4 2024-09-16T03:47:34.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.448+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aede2d7:::benchmark_data_smithi138_27857_object2290:head, will try copies on 0,4 2024-09-16T03:47:34.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.460+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98166a64:::benchmark_data_smithi138_27857_object2041:head, will try copies on 0,4 2024-09-16T03:47:34.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.472+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:47:34.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.484+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:47:34.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a868a2:::benchmark_data_smithi138_27857_object1723:head, will try copies on 2,3 2024-09-16T03:47:34.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.504+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca378d1:::benchmark_data_smithi138_27857_object2115:head, will try copies on 3,4 2024-09-16T03:47:34.530 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.524+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce1eec7:::benchmark_data_smithi138_27857_object639:head, will try copies on 0,4 2024-09-16T03:47:34.619 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bde20a5d:::benchmark_data_smithi138_27857_object3525:head, will try copies on 2,3 2024-09-16T03:47:34.629 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.624+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:47:34.672 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.668+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:34.685 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.680+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5eb4a2:::benchmark_data_smithi138_27857_object1692:head, will try copies on 2,3 2024-09-16T03:47:34.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9e8126:::benchmark_data_smithi138_27857_object2236:head, will try copies on 0,4 2024-09-16T03:47:34.703 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.696+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:47:34.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.704+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2570d06a:::benchmark_data_smithi138_27857_object100:head, will try copies on 0,4 2024-09-16T03:47:34.730 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.724+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b785b7f:::benchmark_data_smithi138_27857_object2492:head, will try copies on 3,4 2024-09-16T03:47:34.734 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.728+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b780eec9:::benchmark_data_smithi138_27857_object508:head, will try copies on 2,3 2024-09-16T03:47:34.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.744+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d460575:::benchmark_data_smithi138_27857_object3152:head, will try copies on 0,4 2024-09-16T03:47:34.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.756+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:47:34.769 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.764+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678ec000:::benchmark_data_smithi138_27857_object3849:head, will try copies on 3,4 2024-09-16T03:47:34.786 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.780+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:508b82e8:::benchmark_data_smithi138_27857_object1227:head, will try copies on 3,4 2024-09-16T03:47:34.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.784+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:47:34.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.796+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:34.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.796+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:34.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.812+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3999f4:::benchmark_data_smithi138_27857_object3003:head, will try copies on 0,4 2024-09-16T03:47:34.828 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.824+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:47:34.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.844+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:47:34.864 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.860+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:34.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.860+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e686444:::benchmark_data_smithi138_27857_object2162:head, will try copies on 3,4 2024-09-16T03:47:34.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.864+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:911e2269:::benchmark_data_smithi138_27857_object3575:head, will try copies on 0,4 2024-09-16T03:47:34.884 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.880+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbd91f8:::benchmark_data_smithi138_27857_object1435:head, will try copies on 3,4 2024-09-16T03:47:34.906 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.900+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da5f4e5:::benchmark_data_smithi138_27857_object2322:head, will try copies on 3,4 2024-09-16T03:47:34.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.912+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:47:34.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.928+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:34.935 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966507ac:::benchmark_data_smithi138_27857_object2663:head, will try copies on 0,4 2024-09-16T03:47:34.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.936+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:34.947 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:47:34.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.952+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:34.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.952+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:47:34.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.960+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:662c445e:::benchmark_data_smithi138_27857_object2971:head, will try copies on 3,4 2024-09-16T03:47:34.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.972+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1633154:::benchmark_data_smithi138_27857_object3392:head, will try copies on 2,3 2024-09-16T03:47:34.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:34.984+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:35.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.000+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be25f53b:::benchmark_data_smithi138_27857_object3423:head, will try copies on 2,3 2024-09-16T03:47:35.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.012+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:47:35.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:47:35.043 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.036+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:47:35.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.064+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:47:35.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.064+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677720f9:::benchmark_data_smithi138_27857_object2067:head, will try copies on 3,4 2024-09-16T03:47:35.076 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.072+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b95b8d44:::benchmark_data_smithi138_27857_object3062:head, will try copies on 2,3 2024-09-16T03:47:35.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.072+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:35.084 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.080+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:47:35.117 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.112+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:35.139 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.132+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e95ccc:::benchmark_data_smithi138_27857_object2341:head, will try copies on 3,4 2024-09-16T03:47:35.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.140+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8981a1:::benchmark_data_smithi138_27857_object1016:head, will try copies on 0,4 2024-09-16T03:47:35.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.156+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:35.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.164+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c04eba9:::benchmark_data_smithi138_27857_object599:head, will try copies on 0,4 2024-09-16T03:47:35.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.164+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:47:35.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.180+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:47:35.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 349 16 4471955 4471939 800.774 727.188 0.000924532 0.00123695 2024-09-16T03:47:35.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.192+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21c2e706:::benchmark_data_smithi138_27857_object371:head, will try copies on 0,4 2024-09-16T03:47:35.200 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.196+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f044a0:::benchmark_data_smithi138_27857_object3709:head, will try copies on 0,4 2024-09-16T03:47:35.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.204+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef9c0bd:::benchmark_data_smithi138_27857_object1671:head, will try copies on 0,4 2024-09-16T03:47:35.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.216+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:547e09fa:::benchmark_data_smithi138_27857_object801:head, will try copies on 3,4 2024-09-16T03:47:35.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.220+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:988d6f61:::benchmark_data_smithi138_27857_object1873:head, will try copies on 0,4 2024-09-16T03:47:35.226 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.220+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:35.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.248+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:47:35.257 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.252+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:47:35.273 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.268+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c816c:::benchmark_data_smithi138_27857_object2786:head, will try copies on 0,4 2024-09-16T03:47:35.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.276+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2419d6d6:::benchmark_data_smithi138_27857_object2261:head, will try copies on 0,4 2024-09-16T03:47:35.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.280+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:47:35.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.308+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:47:35.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.316+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:35.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.316+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2065d6e8:::benchmark_data_smithi138_27857_object1360:head, will try copies on 0,4 2024-09-16T03:47:35.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.328+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99227597:::benchmark_data_smithi138_27857_object1020:head, will try copies on 0,4 2024-09-16T03:47:35.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.336+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:35.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.340+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:47:35.369 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.364+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672b705e:::benchmark_data_smithi138_27857_object281:head, will try copies on 3,4 2024-09-16T03:47:35.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.368+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:47:35.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.372+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:35.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.376+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca5c7:::benchmark_data_smithi138_27857_object3131:head, will try copies on 2,3 2024-09-16T03:47:35.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.396+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:35.403 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.396+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b00f5dc:::benchmark_data_smithi138_27857_object2088:head, will try copies on 3,4 2024-09-16T03:47:35.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.424+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:35.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.428+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:35.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.432+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:35.454 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.448+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:35.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.456+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:47:35.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.456+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2714f5:::benchmark_data_smithi138_27857_object1933:head, will try copies on 0,4 2024-09-16T03:47:35.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.488+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:35.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.504+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2089815b:::benchmark_data_smithi138_27857_object101:head, will try copies on 0,4 2024-09-16T03:47:35.523 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.516+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf5884:::benchmark_data_smithi138_27857_object2038:head, will try copies on 0,4 2024-09-16T03:47:35.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.520+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:47:35.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.528+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cc0f5b7:::benchmark_data_smithi138_27857_object3331:head, will try copies on 3,4 2024-09-16T03:47:35.547 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.540+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b543a505:::benchmark_data_smithi138_27857_object3881:head, will try copies on 2,3 2024-09-16T03:47:35.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.544+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98664879:::benchmark_data_smithi138_27857_object2503:head, will try copies on 0,4 2024-09-16T03:47:35.561 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.556+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:35.586 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.580+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58750b3c:::benchmark_data_smithi138_27857_object1369:head, will try copies on 3,4 2024-09-16T03:47:35.601 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.596+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623c63c9:::benchmark_data_smithi138_27857_object2089:head, will try copies on 3,4 2024-09-16T03:47:35.604 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.600+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bae033a:::benchmark_data_smithi138_27857_object1593:head, will try copies on 0,4 2024-09-16T03:47:35.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.600+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56ab7ec7:::benchmark_data_smithi138_27857_object2872:head, will try copies on 3,4 2024-09-16T03:47:35.607 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.600+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:47:35.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.636+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ab87acb:::benchmark_data_smithi138_27857_object3375:head, will try copies on 0,4 2024-09-16T03:47:35.643 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.636+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:47:35.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.640+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:35.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.656+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:35.674 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.668+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d3321e:::benchmark_data_smithi138_27857_object3269:head, will try copies on 3,4 2024-09-16T03:47:35.679 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.672+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:47:35.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.688+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:47:35.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.692+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:47:35.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.692+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:47:35.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.712+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baad1567:::benchmark_data_smithi138_27857_object573:head, will try copies on 2,3 2024-09-16T03:47:35.725 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.720+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da37fe4:::benchmark_data_smithi138_27857_object3009:head, will try copies on 3,4 2024-09-16T03:47:35.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.732+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:47:35.740 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.736+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af07a71:::benchmark_data_smithi138_27857_object1975:head, will try copies on 0,4 2024-09-16T03:47:35.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.760+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93323ce0:::benchmark_data_smithi138_27857_object1654:head, will try copies on 0,4 2024-09-16T03:47:35.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.764+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:47:35.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.768+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e236b71:::benchmark_data_smithi138_27857_object382:head, will try copies on 3,4 2024-09-16T03:47:35.775 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.768+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:47:35.780 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.776+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590035ac:::benchmark_data_smithi138_27857_object3929:head, will try copies on 3,4 2024-09-16T03:47:35.790 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.784+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58a7313:::benchmark_data_smithi138_27857_object3656:head, will try copies on 2,3 2024-09-16T03:47:35.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.800+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9806ff88:::benchmark_data_smithi138_27857_object3782:head, will try copies on 0,4 2024-09-16T03:47:35.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.820+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ef12c2:::benchmark_data_smithi138_27857_object3060:head, will try copies on 0,4 2024-09-16T03:47:35.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.828+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:47:35.838 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.832+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:47:35.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.844+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b0dd4d:::benchmark_data_smithi138_27857_object2766:head, will try copies on 0,4 2024-09-16T03:47:35.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.860+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56141abf:::benchmark_data_smithi138_27857_object2401:head, will try copies on 3,4 2024-09-16T03:47:35.869 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.864+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:35.883 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.876+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ac8655:::benchmark_data_smithi138_27857_object2626:head, will try copies on 0,4 2024-09-16T03:47:35.895 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.888+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:47:35.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.892+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:35.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.900+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:47:35.915 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.908+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:47:35.921 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.916+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:47:35.925 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.920+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:47:35.929 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.924+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86e69d9:::benchmark_data_smithi138_27857_object288:head, will try copies on 2,3 2024-09-16T03:47:35.973 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.968+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2502bdf9:::benchmark_data_smithi138_27857_object2614:head, will try copies on 0,4 2024-09-16T03:47:35.988 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.984+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9681a53e:::benchmark_data_smithi138_27857_object117:head, will try copies on 0,4 2024-09-16T03:47:35.993 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.988+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d015d12:::benchmark_data_smithi138_27857_object2734:head, will try copies on 3,4 2024-09-16T03:47:36.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:35.996+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:47:36.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:36.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.028+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce7c05e:::benchmark_data_smithi138_27857_object3955:head, will try copies on 3,4 2024-09-16T03:47:36.034 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.028+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:47:36.037 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.028+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9234e089:::benchmark_data_smithi138_27857_object1542:head, will try copies on 0,4 2024-09-16T03:47:36.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.040+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:36.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f777a5:::benchmark_data_smithi138_27857_object45:head, will try copies on 3,4 2024-09-16T03:47:36.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.068+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91490d7e:::benchmark_data_smithi138_27857_object2019:head, will try copies on 0,4 2024-09-16T03:47:36.080 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.076+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:47:36.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.084+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:47:36.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.088+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:36.100 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.096+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:47:36.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.104+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5439c126:::benchmark_data_smithi138_27857_object1853:head, will try copies on 3,4 2024-09-16T03:47:36.110 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.104+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:47:36.135 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.128+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:239af0da:::benchmark_data_smithi138_27857_object534:head, will try copies on 0,4 2024-09-16T03:47:36.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.132+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6284a2ec:::benchmark_data_smithi138_27857_object3221:head, will try copies on 3,4 2024-09-16T03:47:36.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.132+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:36.142 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.136+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8cd41a:::benchmark_data_smithi138_27857_object1174:head, will try copies on 3,4 2024-09-16T03:47:36.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.156+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25750f95:::benchmark_data_smithi138_27857_object1511:head, will try copies on 0,4 2024-09-16T03:47:36.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:36.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 350 16 4484398 4484382 800.707 777.688 0.00655043 0.00123704 2024-09-16T03:47:36.207 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.200+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7ef53:::benchmark_data_smithi138_27857_object1151:head, will try copies on 2,3 2024-09-16T03:47:36.221 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.216+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fa4b9fe:::benchmark_data_smithi138_27857_object2625:head, will try copies on 3,4 2024-09-16T03:47:36.239 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.232+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aaf926a:::benchmark_data_smithi138_27857_object477:head, will try copies on 3,4 2024-09-16T03:47:36.255 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.248+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:47:36.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.252+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5433dd3:::benchmark_data_smithi138_27857_object3521:head, will try copies on 2,3 2024-09-16T03:47:36.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.260+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:47:36.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.276+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22beb0e1:::benchmark_data_smithi138_27857_object3084:head, will try copies on 0,4 2024-09-16T03:47:36.283 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.276+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:36.296 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.292+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:47:36.302 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.296+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:47:36.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.312+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2f69ad6:::benchmark_data_smithi138_27857_object3982:head, will try copies on 2,3 2024-09-16T03:47:36.323 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.316+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:47:36.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.372+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8314a4a:::benchmark_data_smithi138_27857_object309:head, will try copies on 2,3 2024-09-16T03:47:36.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.380+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2217e51f:::benchmark_data_smithi138_27857_object1627:head, will try copies on 0,4 2024-09-16T03:47:36.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.396+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f0a397:::benchmark_data_smithi138_27857_object75:head, will try copies on 3,4 2024-09-16T03:47:36.414 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.408+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:47:36.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.444+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e7317f:::benchmark_data_smithi138_27857_object1614:head, will try copies on 3,4 2024-09-16T03:47:36.457 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.452+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae8cb94:::benchmark_data_smithi138_27857_object2204:head, will try copies on 0,4 2024-09-16T03:47:36.484 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.480+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:47:36.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.484+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:47:36.502 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.496+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:36.512 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.504+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b270b2:::benchmark_data_smithi138_27857_object2056:head, will try copies on 3,4 2024-09-16T03:47:36.531 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.524+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24c21546:::benchmark_data_smithi138_27857_object3161:head, will try copies on 0,4 2024-09-16T03:47:36.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.532+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:36.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.544+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:47:36.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.548+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56935211:::benchmark_data_smithi138_27857_object23:head, will try copies on 3,4 2024-09-16T03:47:36.568 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.564+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a27dd66:::benchmark_data_smithi138_27857_object2478:head, will try copies on 0,4 2024-09-16T03:47:36.576 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.572+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:47:36.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.584+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6123f3aa:::benchmark_data_smithi138_27857_object2418:head, will try copies on 3,4 2024-09-16T03:47:36.592 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.588+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:47:36.621 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.616+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:36.622 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.616+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:47:36.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b900ac03:::benchmark_data_smithi138_27857_object1967:head, will try copies on 2,3 2024-09-16T03:47:36.656 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.648+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961c0575:::benchmark_data_smithi138_27857_object1473:head, will try copies on 0,4 2024-09-16T03:47:36.670 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.664+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c5e7c0b:::benchmark_data_smithi138_27857_object167:head, will try copies on 3,4 2024-09-16T03:47:36.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.676+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:47:36.687 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.680+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:36.689 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.684+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:47:36.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.720+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f440725:::benchmark_data_smithi138_27857_object2454:head, will try copies on 0,4 2024-09-16T03:47:36.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.720+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c31940:::benchmark_data_smithi138_27857_object2520:head, will try copies on 2,3 2024-09-16T03:47:36.727 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:47:36.741 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.736+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:47:36.754 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.748+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b474a7c2:::benchmark_data_smithi138_27857_object2911:head, will try copies on 2,3 2024-09-16T03:47:36.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.768+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:47:36.784 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.780+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:47:36.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.796+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:47:36.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.800+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee85236:::benchmark_data_smithi138_27857_object3163:head, will try copies on 0,4 2024-09-16T03:47:36.817 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.812+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68377fa4:::benchmark_data_smithi138_27857_object3791:head, will try copies on 3,4 2024-09-16T03:47:36.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e4ca40:::benchmark_data_smithi138_27857_object3087:head, will try copies on 3,4 2024-09-16T03:47:36.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:47:36.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.848+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6df380:::benchmark_data_smithi138_27857_object3320:head, will try copies on 3,4 2024-09-16T03:47:36.863 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.856+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd00c08a:::benchmark_data_smithi138_27857_object2964:head, will try copies on 2,3 2024-09-16T03:47:36.868 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.864+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:36.885 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.880+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:267f2854:::benchmark_data_smithi138_27857_object1218:head, will try copies on 0,4 2024-09-16T03:47:36.897 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.892+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b760256:::benchmark_data_smithi138_27857_object821:head, will try copies on 3,4 2024-09-16T03:47:36.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.908+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb4dd8:::benchmark_data_smithi138_27857_object686:head, will try copies on 0,4 2024-09-16T03:47:36.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.908+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:47:36.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.936+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:36.942 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:36.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:36.959 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.952+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cec78c1:::benchmark_data_smithi138_27857_object4056:head, will try copies on 3,4 2024-09-16T03:47:36.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.972+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:47:36.987 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:36.980+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d7fa6:::benchmark_data_smithi138_27857_object3479:head, will try copies on 0,4 2024-09-16T03:47:37.019 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.012+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594ed8a1:::benchmark_data_smithi138_27857_object2821:head, will try copies on 3,4 2024-09-16T03:47:37.022 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.016+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca72d2b:::benchmark_data_smithi138_27857_object2877:head, will try copies on 0,4 2024-09-16T03:47:37.026 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.020+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:47:37.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.040+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:37.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.064+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f326b75:::benchmark_data_smithi138_27857_object3008:head, will try copies on 0,4 2024-09-16T03:47:37.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:47:37.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.072+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:37.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f8d225:::benchmark_data_smithi138_27857_object3376:head, will try copies on 0,4 2024-09-16T03:47:37.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.116+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:37.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.116+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24938231:::benchmark_data_smithi138_27857_object276:head, will try copies on 0,4 2024-09-16T03:47:37.136 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.132+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6efbfcfa:::benchmark_data_smithi138_27857_object1405:head, will try copies on 3,4 2024-09-16T03:47:37.155 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.148+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:47:37.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.152+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09f4697:::benchmark_data_smithi138_27857_object2585:head, will try copies on 2,3 2024-09-16T03:47:37.181 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.176+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcf5f82a:::benchmark_data_smithi138_27857_object759:head, will try copies on 2,3 2024-09-16T03:47:37.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 351 16 4497664 4497648 800.788 829.125 0.000885366 0.00123693 2024-09-16T03:47:37.194 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.188+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd4e430:::benchmark_data_smithi138_27857_object809:head, will try copies on 0,4 2024-09-16T03:47:37.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.204+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b4b188:::benchmark_data_smithi138_27857_object1272:head, will try copies on 2,3 2024-09-16T03:47:37.212 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.208+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77d477:::benchmark_data_smithi138_27857_object3900:head, will try copies on 0,4 2024-09-16T03:47:37.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.224+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:47:37.233 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.228+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:47:37.241 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.236+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6233b493:::benchmark_data_smithi138_27857_object3902:head, will try copies on 3,4 2024-09-16T03:47:37.259 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.252+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:47:37.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.256+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4553d6:::benchmark_data_smithi138_27857_object1072:head, will try copies on 0,4 2024-09-16T03:47:37.289 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.284+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:47:37.295 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.292+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:47:37.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.300+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:37.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.304+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ceee3f:::benchmark_data_smithi138_27857_object635:head, will try copies on 0,4 2024-09-16T03:47:37.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.312+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:47:37.322 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:47:37.324 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.320+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5967f449:::benchmark_data_smithi138_27857_object3267:head, will try copies on 3,4 2024-09-16T03:47:37.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.348+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b620666:::benchmark_data_smithi138_27857_object3408:head, will try copies on 0,4 2024-09-16T03:47:37.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:47:37.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.368+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:47:37.380 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.376+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:47:37.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.380+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc1c6f5:::benchmark_data_smithi138_27857_object713:head, will try copies on 0,4 2024-09-16T03:47:37.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.392+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f13117:::benchmark_data_smithi138_27857_object425:head, will try copies on 3,4 2024-09-16T03:47:37.402 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.396+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e566de:::benchmark_data_smithi138_27857_object523:head, will try copies on 0,4 2024-09-16T03:47:37.407 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.400+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be95a0da:::benchmark_data_smithi138_27857_object3864:head, will try copies on 2,3 2024-09-16T03:47:37.433 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d52691f:::benchmark_data_smithi138_27857_object1848:head, will try copies on 3,4 2024-09-16T03:47:37.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.432+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:37.449 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.444+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:37.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.452+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed3b39b:::benchmark_data_smithi138_27857_object1356:head, will try copies on 3,4 2024-09-16T03:47:37.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.468+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:47:37.476 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.472+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:37.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.480+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:47:37.504 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.500+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eb2c45:::benchmark_data_smithi138_27857_object1818:head, will try copies on 0,4 2024-09-16T03:47:37.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.504+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:47:37.513 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.508+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2c752f:::benchmark_data_smithi138_27857_object3265:head, will try copies on 0,4 2024-09-16T03:47:37.524 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.516+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b38b2c:::benchmark_data_smithi138_27857_object1303:head, will try copies on 2,3 2024-09-16T03:47:37.538 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.532+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:47:37.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.548+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ac6535:::benchmark_data_smithi138_27857_object743:head, will try copies on 0,4 2024-09-16T03:47:37.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.552+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61008be9:::benchmark_data_smithi138_27857_object634:head, will try copies on 3,4 2024-09-16T03:47:37.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.568+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:37.579 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.576+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:37.585 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.580+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc6bd58:::benchmark_data_smithi138_27857_object1157:head, will try copies on 3,4 2024-09-16T03:47:37.589 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.584+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9098e31:::benchmark_data_smithi138_27857_object2728:head, will try copies on 2,3 2024-09-16T03:47:37.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.584+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd0df5:::benchmark_data_smithi138_27857_object2097:head, will try copies on 0,4 2024-09-16T03:47:37.598 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.592+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:37.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.612+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:47:37.623 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.616+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:47:37.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.628+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:37.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.648+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:47:37.657 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.652+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e22a891:::benchmark_data_smithi138_27857_object2980:head, will try copies on 3,4 2024-09-16T03:47:37.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.676+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a10a5:::benchmark_data_smithi138_27857_object3566:head, will try copies on 3,4 2024-09-16T03:47:37.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:47:37.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.708+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28316af7:::benchmark_data_smithi138_27857_object1024:head, will try copies on 0,4 2024-09-16T03:47:37.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.712+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4b6815:::benchmark_data_smithi138_27857_object707:head, will try copies on 2,3 2024-09-16T03:47:37.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.716+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:47:37.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.752+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76efc25:::benchmark_data_smithi138_27857_object913:head, will try copies on 2,3 2024-09-16T03:47:37.760 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.756+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e85d05b:::benchmark_data_smithi138_27857_object267:head, will try copies on 0,4 2024-09-16T03:47:37.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.760+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f67c85b:::benchmark_data_smithi138_27857_object2746:head, will try copies on 3,4 2024-09-16T03:47:37.783 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.776+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6acb619b:::benchmark_data_smithi138_27857_object3970:head, will try copies on 3,4 2024-09-16T03:47:37.793 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.788+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c62e056:::benchmark_data_smithi138_27857_object842:head, will try copies on 0,4 2024-09-16T03:47:37.794 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.788+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:37.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.796+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b687f5d2:::benchmark_data_smithi138_27857_object3233:head, will try copies on 2,3 2024-09-16T03:47:37.808 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.804+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b2bd3a:::benchmark_data_smithi138_27857_object2022:head, will try copies on 3,4 2024-09-16T03:47:37.835 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.828+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:47:37.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.832+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:47:37.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:37.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.848+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:47:37.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.868+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64f589db:::benchmark_data_smithi138_27857_object1998:head, will try copies on 3,4 2024-09-16T03:47:37.876 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.872+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97318974:::benchmark_data_smithi138_27857_object2527:head, will try copies on 0,4 2024-09-16T03:47:37.905 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.900+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95125d5b:::benchmark_data_smithi138_27857_object911:head, will try copies on 0,4 2024-09-16T03:47:37.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.916+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:37.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.940+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a72c5be:::benchmark_data_smithi138_27857_object356:head, will try copies on 0,4 2024-09-16T03:47:37.951 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.944+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f1e6bb:::benchmark_data_smithi138_27857_object2866:head, will try copies on 0,4 2024-09-16T03:47:37.963 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.956+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd097f8:::benchmark_data_smithi138_27857_object1064:head, will try copies on 3,4 2024-09-16T03:47:37.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.960+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c570f0d:::benchmark_data_smithi138_27857_object3880:head, will try copies on 0,4 2024-09-16T03:47:37.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:47:37.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:37.984+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:47:38.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226b9cd2:::benchmark_data_smithi138_27857_object3596:head, will try copies on 0,4 2024-09-16T03:47:38.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.008+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a2caa87:::benchmark_data_smithi138_27857_object1221:head, will try copies on 3,4 2024-09-16T03:47:38.031 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.024+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f0978d:::benchmark_data_smithi138_27857_object3663:head, will try copies on 0,4 2024-09-16T03:47:38.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.032+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:543ea960:::benchmark_data_smithi138_27857_object783:head, will try copies on 3,4 2024-09-16T03:47:38.045 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.040+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634ce785:::benchmark_data_smithi138_27857_object2174:head, will try copies on 3,4 2024-09-16T03:47:38.049 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.044+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:47:38.061 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.056+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b836a23f:::benchmark_data_smithi138_27857_object3859:head, will try copies on 2,3 2024-09-16T03:47:38.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.064+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a98529:::benchmark_data_smithi138_27857_object3461:head, will try copies on 0,4 2024-09-16T03:47:38.081 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.076+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:38.088 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.084+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:47:38.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.088+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98fefe7a:::benchmark_data_smithi138_27857_object4025:head, will try copies on 0,4 2024-09-16T03:47:38.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.096+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0230a0c:::benchmark_data_smithi138_27857_object1715:head, will try copies on 2,3 2024-09-16T03:47:38.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.104+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:681aea36:::benchmark_data_smithi138_27857_object2835:head, will try copies on 3,4 2024-09-16T03:47:38.134 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.128+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:47:38.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.164+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:618fab76:::benchmark_data_smithi138_27857_object1287:head, will try copies on 3,4 2024-09-16T03:47:38.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.172+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:47:38.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.176+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:38.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 352 16 4510280 4510264 800.753 788.5 0.000504046 0.00123699 2024-09-16T03:47:38.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.184+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5791d992:::benchmark_data_smithi138_27857_object253:head, will try copies on 3,4 2024-09-16T03:47:38.201 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.196+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928bbaaa:::benchmark_data_smithi138_27857_object2192:head, will try copies on 0,4 2024-09-16T03:47:38.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.220+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b48bc08a:::benchmark_data_smithi138_27857_object1636:head, will try copies on 2,3 2024-09-16T03:47:38.230 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.224+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e57e744:::benchmark_data_smithi138_27857_object433:head, will try copies on 0,4 2024-09-16T03:47:38.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.228+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af3d0c5:::benchmark_data_smithi138_27857_object1383:head, will try copies on 3,4 2024-09-16T03:47:38.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.240+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538683d4:::benchmark_data_smithi138_27857_object3797:head, will try copies on 3,4 2024-09-16T03:47:38.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260810a1:::benchmark_data_smithi138_27857_object3146:head, will try copies on 0,4 2024-09-16T03:47:38.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.244+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533f2ac:::benchmark_data_smithi138_27857_object2959:head, will try copies on 2,3 2024-09-16T03:47:38.282 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.276+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:47:38.305 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.300+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:47:38.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.300+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:38.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.304+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d348efd:::benchmark_data_smithi138_27857_object1107:head, will try copies on 3,4 2024-09-16T03:47:38.333 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.328+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a2863f:::benchmark_data_smithi138_27857_object498:head, will try copies on 3,4 2024-09-16T03:47:38.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.336+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:248dc567:::benchmark_data_smithi138_27857_object1587:head, will try copies on 0,4 2024-09-16T03:47:38.345 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.340+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cd93ada:::benchmark_data_smithi138_27857_object2631:head, will try copies on 0,4 2024-09-16T03:47:38.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.360+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba62182:::benchmark_data_smithi138_27857_object3578:head, will try copies on 0,4 2024-09-16T03:47:38.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.360+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:47:38.375 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.368+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:47:38.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.380+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2776a9:::benchmark_data_smithi138_27857_object2458:head, will try copies on 0,4 2024-09-16T03:47:38.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.392+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ea74c:::benchmark_data_smithi138_27857_object576:head, will try copies on 3,4 2024-09-16T03:47:38.409 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.404+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:47:38.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.420+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b3923:::benchmark_data_smithi138_27857_object63:head, will try copies on 3,4 2024-09-16T03:47:38.466 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.460+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:47:38.472 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.468+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:38.479 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.472+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57f251bb:::benchmark_data_smithi138_27857_object3143:head, will try copies on 3,4 2024-09-16T03:47:38.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.488+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53bf57a:::benchmark_data_smithi138_27857_object3554:head, will try copies on 2,3 2024-09-16T03:47:38.499 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.492+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8eab35:::benchmark_data_smithi138_27857_object1942:head, will try copies on 0,4 2024-09-16T03:47:38.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.512+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577b5584:::benchmark_data_smithi138_27857_object3047:head, will try copies on 3,4 2024-09-16T03:47:38.522 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.516+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:611b8835:::benchmark_data_smithi138_27857_object8:head, will try copies on 3,4 2024-09-16T03:47:38.539 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.532+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cac7365:::benchmark_data_smithi138_27857_object1519:head, will try copies on 3,4 2024-09-16T03:47:38.553 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.548+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:38.558 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.552+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6539b9be:::benchmark_data_smithi138_27857_object426:head, will try copies on 3,4 2024-09-16T03:47:38.562 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.556+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:38.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.560+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:38.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.600+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:38.627 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:47:38.636 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.632+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:38.637 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.632+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:47:38.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.640+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca727a:::benchmark_data_smithi138_27857_object1632:head, will try copies on 3,4 2024-09-16T03:47:38.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.644+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:38.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.648+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c47fab4:::benchmark_data_smithi138_27857_object3282:head, will try copies on 0,4 2024-09-16T03:47:38.660 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.656+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7d0e08:::benchmark_data_smithi138_27857_object1005:head, will try copies on 0,4 2024-09-16T03:47:38.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.684+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:38.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b26bf07:::benchmark_data_smithi138_27857_object3665:head, will try copies on 0,4 2024-09-16T03:47:38.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.700+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:47:38.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.712+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1a2d:::benchmark_data_smithi138_27857_object3518:head, will try copies on 2,3 2024-09-16T03:47:38.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1dbcca:::benchmark_data_smithi138_27857_object3771:head, will try copies on 3,4 2024-09-16T03:47:38.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.736+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:47:38.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.740+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2400cef6:::benchmark_data_smithi138_27857_object849:head, will try copies on 0,4 2024-09-16T03:47:38.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.756+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd000dd:::benchmark_data_smithi138_27857_object3097:head, will try copies on 2,3 2024-09-16T03:47:38.789 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.784+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:38.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.800+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ce5e523:::benchmark_data_smithi138_27857_object982:head, will try copies on 3,4 2024-09-16T03:47:38.822 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.816+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b846380a:::benchmark_data_smithi138_27857_object539:head, will try copies on 2,3 2024-09-16T03:47:38.849 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.840+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500f4cee:::benchmark_data_smithi138_27857_object2200:head, will try copies on 3,4 2024-09-16T03:47:38.854 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.848+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:47:38.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.856+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf913177:::benchmark_data_smithi138_27857_object1912:head, will try copies on 2,3 2024-09-16T03:47:38.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.868+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:38.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.872+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ef94bff:::benchmark_data_smithi138_27857_object1466:head, will try copies on 0,4 2024-09-16T03:47:38.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.888+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9210e24:::benchmark_data_smithi138_27857_object3838:head, will try copies on 2,3 2024-09-16T03:47:38.894 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.888+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ea4558:::benchmark_data_smithi138_27857_object3182:head, will try copies on 3,4 2024-09-16T03:47:38.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.908+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:38.934 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.928+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27b5038:::benchmark_data_smithi138_27857_object4081:head, will try copies on 2,3 2024-09-16T03:47:38.936 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.932+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:698e9f48:::benchmark_data_smithi138_27857_object1864:head, will try copies on 3,4 2024-09-16T03:47:38.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c8b61f:::benchmark_data_smithi138_27857_object465:head, will try copies on 0,4 2024-09-16T03:47:38.967 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.960+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:47:38.971 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.964+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb8e75db:::benchmark_data_smithi138_27857_object424:head, will try copies on 2,3 2024-09-16T03:47:38.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.972+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b24cb4b:::benchmark_data_smithi138_27857_object365:head, will try copies on 0,4 2024-09-16T03:47:38.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.984+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250d7a76:::benchmark_data_smithi138_27857_object681:head, will try copies on 0,4 2024-09-16T03:47:38.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.984+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0e462a:::benchmark_data_smithi138_27857_object175:head, will try copies on 2,3 2024-09-16T03:47:38.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:38.992+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:47:39.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.004+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:39.013 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.008+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bff8c4a:::benchmark_data_smithi138_27857_object3938:head, will try copies on 0,4 2024-09-16T03:47:39.017 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.012+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92ed0eb:::benchmark_data_smithi138_27857_object1:head, will try copies on 2,3 2024-09-16T03:47:39.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.036+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:47:39.040 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.036+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:47:39.058 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.052+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6e6ac7:::benchmark_data_smithi138_27857_object2657:head, will try copies on 0,4 2024-09-16T03:47:39.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e12291:::benchmark_data_smithi138_27857_object2860:head, will try copies on 0,4 2024-09-16T03:47:39.115 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.108+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:47:39.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.120+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e567b2:::benchmark_data_smithi138_27857_object3516:head, will try copies on 3,4 2024-09-16T03:47:39.125 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.120+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:39.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.124+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94d3617:::benchmark_data_smithi138_27857_object3051:head, will try copies on 2,3 2024-09-16T03:47:39.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.136+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:39.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.172+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e65aa8c:::benchmark_data_smithi138_27857_object1638:head, will try copies on 0,4 2024-09-16T03:47:39.182 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.176+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:47:39.185 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 353 15 4523218 4523203 800.775 808.688 0.000836579 0.00123695 2024-09-16T03:47:39.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972fc8bc:::benchmark_data_smithi138_27857_object2817:head, will try copies on 0,4 2024-09-16T03:47:39.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.232+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947e7929:::benchmark_data_smithi138_27857_object1924:head, will try copies on 0,4 2024-09-16T03:47:39.250 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.244+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d10b88c:::benchmark_data_smithi138_27857_object3459:head, will try copies on 3,4 2024-09-16T03:47:39.256 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.248+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c318c2f:::benchmark_data_smithi138_27857_object3387:head, will try copies on 0,4 2024-09-16T03:47:39.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.256+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6875c4e9:::benchmark_data_smithi138_27857_object3050:head, will try copies on 3,4 2024-09-16T03:47:39.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.268+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989e7d9:::benchmark_data_smithi138_27857_object1951:head, will try copies on 3,4 2024-09-16T03:47:39.309 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef5b811:::benchmark_data_smithi138_27857_object773:head, will try copies on 3,4 2024-09-16T03:47:39.312 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.308+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b13fe87:::benchmark_data_smithi138_27857_object1222:head, will try copies on 0,4 2024-09-16T03:47:39.317 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.312+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b009e96c:::benchmark_data_smithi138_27857_object472:head, will try copies on 2,3 2024-09-16T03:47:39.355 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97bec902:::benchmark_data_smithi138_27857_object2015:head, will try copies on 0,4 2024-09-16T03:47:39.359 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.352+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657b9b70:::benchmark_data_smithi138_27857_object4044:head, will try copies on 3,4 2024-09-16T03:47:39.400 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.396+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:238a9eaa:::benchmark_data_smithi138_27857_object95:head, will try copies on 0,4 2024-09-16T03:47:39.418 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.412+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:47:39.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61bbd50e:::benchmark_data_smithi138_27857_object2289:head, will try copies on 3,4 2024-09-16T03:47:39.429 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.424+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56637449:::benchmark_data_smithi138_27857_object3762:head, will try copies on 3,4 2024-09-16T03:47:39.437 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.432+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:47:39.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.436+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0cc976:::benchmark_data_smithi138_27857_object3909:head, will try copies on 0,4 2024-09-16T03:47:39.458 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.452+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b605b61:::benchmark_data_smithi138_27857_object3784:head, will try copies on 3,4 2024-09-16T03:47:39.470 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.464+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:47:39.490 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.484+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9daec9:::benchmark_data_smithi138_27857_object799:head, will try copies on 3,4 2024-09-16T03:47:39.494 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:47:39.507 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.500+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:47:39.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.520+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:47:39.529 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.524+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9c2bc0:::benchmark_data_smithi138_27857_object113:head, will try copies on 3,4 2024-09-16T03:47:39.567 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.560+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba0fa0e:::benchmark_data_smithi138_27857_object915:head, will try copies on 3,4 2024-09-16T03:47:39.648 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.640+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55b00b17:::benchmark_data_smithi138_27857_object3746:head, will try copies on 3,4 2024-09-16T03:47:39.671 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.664+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc47ab3:::benchmark_data_smithi138_27857_object1611:head, will try copies on 0,4 2024-09-16T03:47:39.678 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.672+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:47:39.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.676+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97305f30:::benchmark_data_smithi138_27857_object3356:head, will try copies on 0,4 2024-09-16T03:47:39.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.680+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:47:39.708 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.704+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6468d601:::benchmark_data_smithi138_27857_object810:head, will try copies on 3,4 2024-09-16T03:47:39.720 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.716+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:47:39.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.720+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3a0164:::benchmark_data_smithi138_27857_object946:head, will try copies on 3,4 2024-09-16T03:47:39.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.748+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:39.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.748+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f02ddcc:::benchmark_data_smithi138_27857_object295:head, will try copies on 3,4 2024-09-16T03:47:39.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:47:39.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.772+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298b2fb1:::benchmark_data_smithi138_27857_object2217:head, will try copies on 0,4 2024-09-16T03:47:39.779 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.772+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:680226f1:::benchmark_data_smithi138_27857_object1190:head, will try copies on 3,4 2024-09-16T03:47:39.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.800+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b78e0d63:::benchmark_data_smithi138_27857_object3268:head, will try copies on 2,3 2024-09-16T03:47:39.816 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.812+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c963c73:::benchmark_data_smithi138_27857_object1496:head, will try copies on 3,4 2024-09-16T03:47:39.823 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cad3d3c:::benchmark_data_smithi138_27857_object1206:head, will try copies on 3,4 2024-09-16T03:47:39.827 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.820+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f5f09f:::benchmark_data_smithi138_27857_object578:head, will try copies on 0,4 2024-09-16T03:47:39.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.844+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be36426a:::benchmark_data_smithi138_27857_object1545:head, will try copies on 2,3 2024-09-16T03:47:39.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.856+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f529f07:::benchmark_data_smithi138_27857_object505:head, will try copies on 3,4 2024-09-16T03:47:39.878 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.872+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a6882a8:::benchmark_data_smithi138_27857_object656:head, will try copies on 0,4 2024-09-16T03:47:39.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.880+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f831b5f:::benchmark_data_smithi138_27857_object1417:head, will try copies on 3,4 2024-09-16T03:47:39.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.880+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:47:39.907 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.900+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc0d3d1:::benchmark_data_smithi138_27857_object92:head, will try copies on 3,4 2024-09-16T03:47:39.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.908+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68cb32cc:::benchmark_data_smithi138_27857_object826:head, will try copies on 3,4 2024-09-16T03:47:39.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f410694:::benchmark_data_smithi138_27857_object2008:head, will try copies on 0,4 2024-09-16T03:47:39.960 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.956+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:39.977 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d690eca:::benchmark_data_smithi138_27857_object3451:head, will try copies on 0,4 2024-09-16T03:47:39.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.992+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aace810:::benchmark_data_smithi138_27857_object1014:head, will try copies on 0,4 2024-09-16T03:47:39.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:39.992+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527f3225:::benchmark_data_smithi138_27857_object3307:head, will try copies on 3,4 2024-09-16T03:47:40.004 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.000+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3abf90:::benchmark_data_smithi138_27857_object618:head, will try copies on 0,4 2024-09-16T03:47:40.012 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.008+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2600d295:::benchmark_data_smithi138_27857_object3915:head, will try copies on 0,4 2024-09-16T03:47:40.029 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.024+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:47:40.044 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.040+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d9fc57:::benchmark_data_smithi138_27857_object2925:head, will try copies on 2,3 2024-09-16T03:47:40.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.056+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206a7e30:::benchmark_data_smithi138_27857_object3851:head, will try copies on 0,4 2024-09-16T03:47:40.066 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.060+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc472:::benchmark_data_smithi138_27857_object203:head, will try copies on 3,4 2024-09-16T03:47:40.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:47:40.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.080+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24553cae:::benchmark_data_smithi138_27857_object3409:head, will try copies on 0,4 2024-09-16T03:47:40.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.124+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:40.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.124+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:40.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.124+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:47:40.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.152+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5b9f1:::benchmark_data_smithi138_27857_object852:head, will try copies on 3,4 2024-09-16T03:47:40.169 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.164+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21344282:::benchmark_data_smithi138_27857_object2994:head, will try copies on 0,4 2024-09-16T03:47:40.173 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.168+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594cf78d:::benchmark_data_smithi138_27857_object3573:head, will try copies on 3,4 2024-09-16T03:47:40.178 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.172+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:40.185 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.180+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843aa27:::benchmark_data_smithi138_27857_object1891:head, will try copies on 0,4 2024-09-16T03:47:40.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 354 16 4534539 4534523 800.512 707.5 0.000712802 0.00123736 2024-09-16T03:47:40.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.204+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4e56f:::benchmark_data_smithi138_27857_object388:head, will try copies on 3,4 2024-09-16T03:47:40.211 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.204+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ec1e100:::benchmark_data_smithi138_27857_object1732:head, will try copies on 0,4 2024-09-16T03:47:40.224 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.220+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:47:40.229 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.224+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:47:40.236 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.232+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27be2808:::benchmark_data_smithi138_27857_object701:head, will try copies on 0,4 2024-09-16T03:47:40.244 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.240+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:47:40.261 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.256+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:47:40.266 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.260+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:47:40.280 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.276+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cb884e:::benchmark_data_smithi138_27857_object1666:head, will try copies on 3,4 2024-09-16T03:47:40.281 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.276+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:47:40.306 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.300+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1464d23:::benchmark_data_smithi138_27857_object1571:head, will try copies on 2,3 2024-09-16T03:47:40.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.316+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc465264:::benchmark_data_smithi138_27857_object671:head, will try copies on 2,3 2024-09-16T03:47:40.328 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.324+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5476b7a4:::benchmark_data_smithi138_27857_object3508:head, will try copies on 3,4 2024-09-16T03:47:40.331 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.324+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:40.342 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.336+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:47:40.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.340+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9e72c1:::benchmark_data_smithi138_27857_object2473:head, will try copies on 3,4 2024-09-16T03:47:40.354 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.348+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf6b9bb3:::benchmark_data_smithi138_27857_object2107:head, will try copies on 2,3 2024-09-16T03:47:40.367 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.360+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:47:40.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.392+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b31ca27c:::benchmark_data_smithi138_27857_object3289:head, will try copies on 2,3 2024-09-16T03:47:40.398 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.392+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90dfb035:::benchmark_data_smithi138_27857_object1841:head, will try copies on 0,4 2024-09-16T03:47:40.420 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.416+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b622472:::benchmark_data_smithi138_27857_object1869:head, will try copies on 3,4 2024-09-16T03:47:40.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.436+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:47:40.445 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.440+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:47:40.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.464+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dce19a:::benchmark_data_smithi138_27857_object3927:head, will try copies on 3,4 2024-09-16T03:47:40.488 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.480+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a3f81b:::benchmark_data_smithi138_27857_object3670:head, will try copies on 0,4 2024-09-16T03:47:40.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.484+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595c879c:::benchmark_data_smithi138_27857_object1680:head, will try copies on 3,4 2024-09-16T03:47:40.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.492+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5e69e5:::benchmark_data_smithi138_27857_object3108:head, will try copies on 3,4 2024-09-16T03:47:40.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.520+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:47:40.528 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.524+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:47:40.545 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.540+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:47:40.546 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.540+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:40.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.544+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e3067f4:::benchmark_data_smithi138_27857_object1659:head, will try copies on 3,4 2024-09-16T03:47:40.557 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.552+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ee9c38:::benchmark_data_smithi138_27857_object1683:head, will try copies on 3,4 2024-09-16T03:47:40.569 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.564+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:47:40.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.564+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b299683:::benchmark_data_smithi138_27857_object200:head, will try copies on 0,4 2024-09-16T03:47:40.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.568+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:47:40.590 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.584+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:956e6d4d:::benchmark_data_smithi138_27857_object1782:head, will try copies on 0,4 2024-09-16T03:47:40.610 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.604+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53edd14a:::benchmark_data_smithi138_27857_object2719:head, will try copies on 3,4 2024-09-16T03:47:40.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.620+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e5e7841:::benchmark_data_smithi138_27857_object3189:head, will try copies on 3,4 2024-09-16T03:47:40.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.624+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:47:40.639 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.632+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65f5eddc:::benchmark_data_smithi138_27857_object824:head, will try copies on 3,4 2024-09-16T03:47:40.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.640+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:40.651 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.644+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8873b4:::benchmark_data_smithi138_27857_object3937:head, will try copies on 0,4 2024-09-16T03:47:40.676 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.672+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:637883f4:::benchmark_data_smithi138_27857_object3598:head, will try copies on 3,4 2024-09-16T03:47:40.696 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.692+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb4c17e:::benchmark_data_smithi138_27857_object989:head, will try copies on 0,4 2024-09-16T03:47:40.697 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.692+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:40.715 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.708+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97e5defc:::benchmark_data_smithi138_27857_object3803:head, will try copies on 0,4 2024-09-16T03:47:40.729 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.724+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:47:40.737 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.732+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0d73bb:::benchmark_data_smithi138_27857_object633:head, will try copies on 3,4 2024-09-16T03:47:40.752 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.748+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c6c013:::benchmark_data_smithi138_27857_object4021:head, will try copies on 0,4 2024-09-16T03:47:40.762 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.756+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:634e3723:::benchmark_data_smithi138_27857_object2995:head, will try copies on 3,4 2024-09-16T03:47:40.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968c22b3:::benchmark_data_smithi138_27857_object2307:head, will try copies on 0,4 2024-09-16T03:47:40.778 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.772+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:40.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.816+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea5418e:::benchmark_data_smithi138_27857_object3635:head, will try copies on 3,4 2024-09-16T03:47:40.821 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.816+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9590413a:::benchmark_data_smithi138_27857_object3361:head, will try copies on 0,4 2024-09-16T03:47:40.826 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.820+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:675d0803:::benchmark_data_smithi138_27857_object3349:head, will try copies on 3,4 2024-09-16T03:47:40.837 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.832+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2b4b26:::benchmark_data_smithi138_27857_object1854:head, will try copies on 3,4 2024-09-16T03:47:40.850 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.844+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:40.879 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.872+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:40.886 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.880+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dff29b8:::benchmark_data_smithi138_27857_object3036:head, will try copies on 0,4 2024-09-16T03:47:40.898 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.892+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb7198c3:::benchmark_data_smithi138_27857_object673:head, will try copies on 2,3 2024-09-16T03:47:40.901 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.896+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc581a:::benchmark_data_smithi138_27857_object1278:head, will try copies on 3,4 2024-09-16T03:47:40.904 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.900+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:47:40.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.924+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c3fd26d:::benchmark_data_smithi138_27857_object3378:head, will try copies on 3,4 2024-09-16T03:47:40.933 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.928+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:47:40.958 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.952+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68070f11:::benchmark_data_smithi138_27857_object3502:head, will try copies on 3,4 2024-09-16T03:47:40.986 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.980+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d8b811:::benchmark_data_smithi138_27857_object2233:head, will try copies on 0,4 2024-09-16T03:47:40.989 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.984+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbdbab5c:::benchmark_data_smithi138_27857_object3197:head, will try copies on 2,3 2024-09-16T03:47:40.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.988+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:47:40.997 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:40.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:41.016 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.012+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e3fee2:::benchmark_data_smithi138_27857_object3572:head, will try copies on 3,4 2024-09-16T03:47:41.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:41.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.048+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:41.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f459d3:::benchmark_data_smithi138_27857_object2891:head, will try copies on 2,3 2024-09-16T03:47:41.071 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:47:41.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.072+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:47:41.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.104+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9bfba5e:::benchmark_data_smithi138_27857_object394:head, will try copies on 2,3 2024-09-16T03:47:41.111 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.104+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9382ec2a:::benchmark_data_smithi138_27857_object1423:head, will try copies on 0,4 2024-09-16T03:47:41.126 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.120+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:47:41.127 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.120+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56deb30b:::benchmark_data_smithi138_27857_object351:head, will try copies on 3,4 2024-09-16T03:47:41.138 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.132+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:927485a2:::benchmark_data_smithi138_27857_object653:head, will try copies on 0,4 2024-09-16T03:47:41.143 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.140+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:41.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5feb607e:::benchmark_data_smithi138_27857_object2915:head, will try copies on 3,4 2024-09-16T03:47:41.157 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.152+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:47:41.179 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.172+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695dc951:::benchmark_data_smithi138_27857_object1510:head, will try copies on 3,4 2024-09-16T03:47:41.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 355 16 4547713 4547697 800.576 823.375 0.000943979 0.00123727 2024-09-16T03:47:41.196 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.192+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f55710:::benchmark_data_smithi138_27857_object2731:head, will try copies on 2,3 2024-09-16T03:47:41.199 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9126c8cb:::benchmark_data_smithi138_27857_object1646:head, will try copies on 0,4 2024-09-16T03:47:41.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.196+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:41.216 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.212+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:47:41.219 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.212+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:245a4117:::benchmark_data_smithi138_27857_object3000:head, will try copies on 0,4 2024-09-16T03:47:41.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.228+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90219fba:::benchmark_data_smithi138_27857_object1045:head, will try copies on 0,4 2024-09-16T03:47:41.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.244+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6669e517:::benchmark_data_smithi138_27857_object2501:head, will try copies on 3,4 2024-09-16T03:47:41.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.244+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:41.269 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.264+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e420c4:::benchmark_data_smithi138_27857_object273:head, will try copies on 0,4 2024-09-16T03:47:41.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.280+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:47:41.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.312+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95df037d:::benchmark_data_smithi138_27857_object2590:head, will try copies on 0,4 2024-09-16T03:47:41.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.320+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566cdac0:::benchmark_data_smithi138_27857_object207:head, will try copies on 3,4 2024-09-16T03:47:41.338 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.332+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:47:41.356 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.352+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:47:41.378 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.372+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925bd15e:::benchmark_data_smithi138_27857_object626:head, will try copies on 0,4 2024-09-16T03:47:41.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.380+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa0bbdd:::benchmark_data_smithi138_27857_object3898:head, will try copies on 2,3 2024-09-16T03:47:41.391 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.384+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968fa456:::benchmark_data_smithi138_27857_object865:head, will try copies on 0,4 2024-09-16T03:47:41.401 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.396+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64326df2:::benchmark_data_smithi138_27857_object2553:head, will try copies on 3,4 2024-09-16T03:47:41.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.412+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac9ca92:::benchmark_data_smithi138_27857_object923:head, will try copies on 0,4 2024-09-16T03:47:41.417 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.412+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b91d6ece:::benchmark_data_smithi138_27857_object2599:head, will try copies on 2,3 2024-09-16T03:47:41.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.416+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68315a53:::benchmark_data_smithi138_27857_object3529:head, will try copies on 3,4 2024-09-16T03:47:41.424 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.420+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53571487:::benchmark_data_smithi138_27857_object3734:head, will try copies on 3,4 2024-09-16T03:47:41.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.424+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc85bfa7:::benchmark_data_smithi138_27857_object1557:head, will try copies on 2,3 2024-09-16T03:47:41.448 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.444+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:47:41.465 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.460+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628305d6:::benchmark_data_smithi138_27857_object1080:head, will try copies on 3,4 2024-09-16T03:47:41.487 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.480+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9c57992:::benchmark_data_smithi138_27857_object4026:head, will try copies on 2,3 2024-09-16T03:47:41.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.488+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24a50df9:::benchmark_data_smithi138_27857_object2073:head, will try copies on 0,4 2024-09-16T03:47:41.508 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.504+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb4eede:::benchmark_data_smithi138_27857_object1314:head, will try copies on 3,4 2024-09-16T03:47:41.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.504+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22e31ba:::benchmark_data_smithi138_27857_object3353:head, will try copies on 2,3 2024-09-16T03:47:41.510 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.504+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:973d78cb:::benchmark_data_smithi138_27857_object2292:head, will try copies on 0,4 2024-09-16T03:47:41.525 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.520+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa986c0:::benchmark_data_smithi138_27857_object118:head, will try copies on 3,4 2024-09-16T03:47:41.526 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.520+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e860ba2:::benchmark_data_smithi138_27857_object665:head, will try copies on 3,4 2024-09-16T03:47:41.543 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.536+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc872c25:::benchmark_data_smithi138_27857_object2675:head, will try copies on 2,3 2024-09-16T03:47:41.554 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.548+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b46f87:::benchmark_data_smithi138_27857_object589:head, will try copies on 0,4 2024-09-16T03:47:41.565 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.560+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:41.571 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.568+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:41.580 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9060ec65:::benchmark_data_smithi138_27857_object4088:head, will try copies on 0,4 2024-09-16T03:47:41.594 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.588+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:41.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.608+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96f22a2:::benchmark_data_smithi138_27857_object1691:head, will try copies on 2,3 2024-09-16T03:47:41.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.612+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91b7040f:::benchmark_data_smithi138_27857_object3338:head, will try copies on 0,4 2024-09-16T03:47:41.624 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.620+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664bc86d:::benchmark_data_smithi138_27857_object141:head, will try copies on 3,4 2024-09-16T03:47:41.632 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.628+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5482d4:::benchmark_data_smithi138_27857_object35:head, will try copies on 3,4 2024-09-16T03:47:41.641 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.636+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98afb7d0:::benchmark_data_smithi138_27857_object2109:head, will try copies on 0,4 2024-09-16T03:47:41.664 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.660+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:47:41.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.664+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf8557e:::benchmark_data_smithi138_27857_object1996:head, will try copies on 3,4 2024-09-16T03:47:41.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.680+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:41.690 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.684+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:41.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.688+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:47:41.717 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.712+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:47:41.718 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.712+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e75a172:::benchmark_data_smithi138_27857_object828:head, will try copies on 0,4 2024-09-16T03:47:41.742 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.736+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:47:41.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268a000c:::benchmark_data_smithi138_27857_object1347:head, will try copies on 0,4 2024-09-16T03:47:41.773 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.768+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6335778:::benchmark_data_smithi138_27857_object3808:head, will try copies on 2,3 2024-09-16T03:47:41.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.768+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a0c4b6d:::benchmark_data_smithi138_27857_object161:head, will try copies on 0,4 2024-09-16T03:47:41.791 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.784+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e620ec:::benchmark_data_smithi138_27857_object1714:head, will try copies on 3,4 2024-09-16T03:47:41.800 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:47:41.807 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.800+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:47:41.810 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.804+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234de68c:::benchmark_data_smithi138_27857_object1156:head, will try copies on 0,4 2024-09-16T03:47:41.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.816+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:47:41.845 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.840+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8f5365:::benchmark_data_smithi138_27857_object999:head, will try copies on 0,4 2024-09-16T03:47:41.861 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.856+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60eb7b85:::benchmark_data_smithi138_27857_object401:head, will try copies on 3,4 2024-09-16T03:47:41.865 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.860+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:41.891 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.884+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cf7569d:::benchmark_data_smithi138_27857_object3247:head, will try copies on 3,4 2024-09-16T03:47:41.902 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.896+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6612dbed:::benchmark_data_smithi138_27857_object3099:head, will try copies on 3,4 2024-09-16T03:47:41.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.904+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9950164b:::benchmark_data_smithi138_27857_object1468:head, will try copies on 0,4 2024-09-16T03:47:41.912 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.908+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25411835:::benchmark_data_smithi138_27857_object1523:head, will try copies on 0,4 2024-09-16T03:47:41.913 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.908+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:47:41.928 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.924+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9439e2eb:::benchmark_data_smithi138_27857_object3615:head, will try copies on 0,4 2024-09-16T03:47:41.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.936+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a194ee6:::benchmark_data_smithi138_27857_object2683:head, will try copies on 0,4 2024-09-16T03:47:41.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.940+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:41.974 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.968+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5db6c:::benchmark_data_smithi138_27857_object4009:head, will try copies on 3,4 2024-09-16T03:47:41.994 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.988+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5153ce62:::benchmark_data_smithi138_27857_object1733:head, will try copies on 3,4 2024-09-16T03:47:41.998 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:41.992+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6464c14:::benchmark_data_smithi138_27857_object3700:head, will try copies on 2,3 2024-09-16T03:47:42.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.004+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5170a9a4:::benchmark_data_smithi138_27857_object742:head, will try copies on 3,4 2024-09-16T03:47:42.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.008+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a2e203:::benchmark_data_smithi138_27857_object1108:head, will try copies on 0,4 2024-09-16T03:47:42.020 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.016+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67514db1:::benchmark_data_smithi138_27857_object3873:head, will try copies on 3,4 2024-09-16T03:47:42.030 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.024+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab6977d:::benchmark_data_smithi138_27857_object3341:head, will try copies on 2,3 2024-09-16T03:47:42.051 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.048+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:42.068 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.064+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6ce32a:::benchmark_data_smithi138_27857_object719:head, will try copies on 2,3 2024-09-16T03:47:42.070 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.064+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de1bfa6:::benchmark_data_smithi138_27857_object2945:head, will try copies on 3,4 2024-09-16T03:47:42.085 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.080+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e05c3ad:::benchmark_data_smithi138_27857_object1068:head, will try copies on 0,4 2024-09-16T03:47:42.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.088+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:42.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.096+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536f1c6b:::benchmark_data_smithi138_27857_object317:head, will try copies on 3,4 2024-09-16T03:47:42.114 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.108+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afa056c:::benchmark_data_smithi138_27857_object859:head, will try copies on 3,4 2024-09-16T03:47:42.120 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.116+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef6b70d:::benchmark_data_smithi138_27857_object1105:head, will try copies on 3,4 2024-09-16T03:47:42.140 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.136+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b60eba:::benchmark_data_smithi138_27857_object29:head, will try copies on 3,4 2024-09-16T03:47:42.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.176+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:42.183 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.180+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:47:42.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 356 16 4560780 4560764 800.621 816.688 0.000612623 0.0012372 2024-09-16T03:47:42.186 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.180+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d77a81:::benchmark_data_smithi138_27857_object3586:head, will try copies on 3,4 2024-09-16T03:47:42.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.204+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d38d61a:::benchmark_data_smithi138_27857_object502:head, will try copies on 0,4 2024-09-16T03:47:42.209 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.204+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bf4d1f1:::benchmark_data_smithi138_27857_object2091:head, will try copies on 0,4 2024-09-16T03:47:42.235 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.228+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98d3cf08:::benchmark_data_smithi138_27857_object2612:head, will try copies on 0,4 2024-09-16T03:47:42.258 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.252+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b306abbc:::benchmark_data_smithi138_27857_object3477:head, will try copies on 2,3 2024-09-16T03:47:42.260 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.256+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cba7014:::benchmark_data_smithi138_27857_object3191:head, will try copies on 0,4 2024-09-16T03:47:42.268 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.264+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da2e92b:::benchmark_data_smithi138_27857_object2810:head, will try copies on 3,4 2024-09-16T03:47:42.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.272+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6331c4cc:::benchmark_data_smithi138_27857_object2827:head, will try copies on 3,4 2024-09-16T03:47:42.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.280+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202ebd5e:::benchmark_data_smithi138_27857_object815:head, will try copies on 0,4 2024-09-16T03:47:42.294 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.288+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfe7dc3:::benchmark_data_smithi138_27857_object2222:head, will try copies on 0,4 2024-09-16T03:47:42.310 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.304+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee292ac:::benchmark_data_smithi138_27857_object2652:head, will try copies on 2,3 2024-09-16T03:47:42.329 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.312+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb42fa2:::benchmark_data_smithi138_27857_object3594:head, will try copies on 3,4 2024-09-16T03:47:42.335 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.328+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9166cd75:::benchmark_data_smithi138_27857_object3545:head, will try copies on 0,4 2024-09-16T03:47:42.340 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.336+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b716cd96:::benchmark_data_smithi138_27857_object1625:head, will try copies on 2,3 2024-09-16T03:47:42.365 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.360+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9742f8f2:::benchmark_data_smithi138_27857_object3551:head, will try copies on 0,4 2024-09-16T03:47:42.372 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.368+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aad2eaf:::benchmark_data_smithi138_27857_object2014:head, will try copies on 3,4 2024-09-16T03:47:42.385 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.380+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbad3466:::benchmark_data_smithi138_27857_object2300:head, will try copies on 2,3 2024-09-16T03:47:42.395 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.388+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e2b306b:::benchmark_data_smithi138_27857_object2306:head, will try copies on 3,4 2024-09-16T03:47:42.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.392+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e08f95f:::benchmark_data_smithi138_27857_object274:head, will try copies on 0,4 2024-09-16T03:47:42.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.428+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:47:42.441 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.436+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:42.442 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.436+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:42.447 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.440+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:47:42.482 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.476+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:42.483 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.476+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be3c448:::benchmark_data_smithi138_27857_object1556:head, will try copies on 3,4 2024-09-16T03:47:42.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.484+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d20eae:::benchmark_data_smithi138_27857_object886:head, will try copies on 2,3 2024-09-16T03:47:42.491 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.484+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d3734c:::benchmark_data_smithi138_27857_object3449:head, will try copies on 0,4 2024-09-16T03:47:42.511 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.504+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95877249:::benchmark_data_smithi138_27857_object3703:head, will try copies on 0,4 2024-09-16T03:47:42.536 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.532+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21793c72:::benchmark_data_smithi138_27857_object2134:head, will try copies on 0,4 2024-09-16T03:47:42.540 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.536+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0247d6d:::benchmark_data_smithi138_27857_object2682:head, will try copies on 2,3 2024-09-16T03:47:42.559 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.552+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298cfc5a:::benchmark_data_smithi138_27857_object1243:head, will try copies on 0,4 2024-09-16T03:47:42.584 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.580+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986c037d:::benchmark_data_smithi138_27857_object988:head, will try copies on 0,4 2024-09-16T03:47:42.588 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.584+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afca26f:::benchmark_data_smithi138_27857_object781:head, will try copies on 0,4 2024-09-16T03:47:42.593 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.588+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba16998:::benchmark_data_smithi138_27857_object3843:head, will try copies on 3,4 2024-09-16T03:47:42.626 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.620+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdf5b231:::benchmark_data_smithi138_27857_object684:head, will try copies on 2,3 2024-09-16T03:47:42.642 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.636+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e117cc:::benchmark_data_smithi138_27857_object3088:head, will try copies on 2,3 2024-09-16T03:47:42.647 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.640+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b5f3ca:::benchmark_data_smithi138_27857_object2698:head, will try copies on 0,4 2024-09-16T03:47:42.652 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.648+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54817c4e:::benchmark_data_smithi138_27857_object2308:head, will try copies on 3,4 2024-09-16T03:47:42.669 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.664+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2be8c128:::benchmark_data_smithi138_27857_object224:head, will try copies on 0,4 2024-09-16T03:47:42.680 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.676+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:47:42.691 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.684+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589a449e:::benchmark_data_smithi138_27857_object1758:head, will try copies on 3,4 2024-09-16T03:47:42.698 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.692+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99153086:::benchmark_data_smithi138_27857_object919:head, will try copies on 0,4 2024-09-16T03:47:42.710 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.704+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:42.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.716+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:47:42.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.716+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6848b6d3:::benchmark_data_smithi138_27857_object790:head, will try copies on 3,4 2024-09-16T03:47:42.724 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.720+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d89293:::benchmark_data_smithi138_27857_object111:head, will try copies on 3,4 2024-09-16T03:47:42.750 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.744+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b817bbbd:::benchmark_data_smithi138_27857_object2879:head, will try copies on 2,3 2024-09-16T03:47:42.755 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.748+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cafa95:::benchmark_data_smithi138_27857_object3758:head, will try copies on 0,4 2024-09-16T03:47:42.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.760+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a30c32f:::benchmark_data_smithi138_27857_object2946:head, will try copies on 3,4 2024-09-16T03:47:42.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99115b75:::benchmark_data_smithi138_27857_object1083:head, will try copies on 0,4 2024-09-16T03:47:42.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.780+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0c4998:::benchmark_data_smithi138_27857_object2664:head, will try copies on 3,4 2024-09-16T03:47:42.801 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.796+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b678a8c7:::benchmark_data_smithi138_27857_object1315:head, will try copies on 2,3 2024-09-16T03:47:42.802 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.796+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9573dd4d:::benchmark_data_smithi138_27857_object1781:head, will try copies on 0,4 2024-09-16T03:47:42.804 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.800+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef26246:::benchmark_data_smithi138_27857_object2852:head, will try copies on 3,4 2024-09-16T03:47:42.832 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.828+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221763c9:::benchmark_data_smithi138_27857_object2725:head, will try copies on 0,4 2024-09-16T03:47:42.843 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.836+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b1ee3:::benchmark_data_smithi138_27857_object3688:head, will try copies on 2,3 2024-09-16T03:47:42.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.840+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648d7f38:::benchmark_data_smithi138_27857_object1225:head, will try copies on 3,4 2024-09-16T03:47:42.852 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.848+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:47:42.871 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.868+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efb69a0:::benchmark_data_smithi138_27857_object2823:head, will try copies on 3,4 2024-09-16T03:47:42.899 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.892+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1a690f:::benchmark_data_smithi138_27857_object3690:head, will try copies on 3,4 2024-09-16T03:47:42.908 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.904+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1e40d7:::benchmark_data_smithi138_27857_object4015:head, will try copies on 0,4 2024-09-16T03:47:42.927 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.920+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52841d38:::benchmark_data_smithi138_27857_object196:head, will try copies on 3,4 2024-09-16T03:47:42.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.936+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e84cf47:::benchmark_data_smithi138_27857_object1525:head, will try copies on 0,4 2024-09-16T03:47:42.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28743962:::benchmark_data_smithi138_27857_object4062:head, will try copies on 0,4 2024-09-16T03:47:42.943 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.936+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c37a797:::benchmark_data_smithi138_27857_object2005:head, will try copies on 3,4 2024-09-16T03:47:42.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.964+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a40a5af:::benchmark_data_smithi138_27857_object1295:head, will try copies on 0,4 2024-09-16T03:47:42.981 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.976+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7d8256:::benchmark_data_smithi138_27857_object3678:head, will try copies on 3,4 2024-09-16T03:47:42.990 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:42.984+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c8f536:::benchmark_data_smithi138_27857_object58:head, will try copies on 0,4 2024-09-16T03:47:43.009 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.004+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abfd377:::benchmark_data_smithi138_27857_object3681:head, will try copies on 0,4 2024-09-16T03:47:43.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.012+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b5314:::benchmark_data_smithi138_27857_object3585:head, will try copies on 2,3 2024-09-16T03:47:43.028 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.024+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:47:43.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.028+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:903f1d4a:::benchmark_data_smithi138_27857_object1740:head, will try copies on 0,4 2024-09-16T03:47:43.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.032+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67137a52:::benchmark_data_smithi138_27857_object3699:head, will try copies on 3,4 2024-09-16T03:47:43.042 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.036+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26661bec:::benchmark_data_smithi138_27857_object1077:head, will try copies on 0,4 2024-09-16T03:47:43.054 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.048+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bfbe5af:::benchmark_data_smithi138_27857_object2720:head, will try copies on 0,4 2024-09-16T03:47:43.073 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.068+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d197500:::benchmark_data_smithi138_27857_object3323:head, will try copies on 3,4 2024-09-16T03:47:43.077 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.072+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97b7e8af:::benchmark_data_smithi138_27857_object1048:head, will try copies on 0,4 2024-09-16T03:47:43.086 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.080+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:560af54a:::benchmark_data_smithi138_27857_object3364:head, will try copies on 3,4 2024-09-16T03:47:43.108 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.100+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88e6e87:::benchmark_data_smithi138_27857_object3609:head, will try copies on 2,3 2024-09-16T03:47:43.109 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.104+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa7a6c7:::benchmark_data_smithi138_27857_object723:head, will try copies on 0,4 2024-09-16T03:47:43.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.112+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:47:43.129 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.124+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584427d8:::benchmark_data_smithi138_27857_object1684:head, will try copies on 3,4 2024-09-16T03:47:43.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.136+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fcc0839:::benchmark_data_smithi138_27857_object2483:head, will try copies on 0,4 2024-09-16T03:47:43.152 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.148+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57a7dcdc:::benchmark_data_smithi138_27857_object3637:head, will try copies on 3,4 2024-09-16T03:47:43.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.152+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fc34958:::benchmark_data_smithi138_27857_object1331:head, will try copies on 3,4 2024-09-16T03:47:43.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.168+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:43.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 357 16 4574010 4573994 800.694 826.875 0.000527769 0.00123708 2024-09-16T03:47:43.188 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.184+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b920abe4:::benchmark_data_smithi138_27857_object4121:head, will try copies on 2,3 2024-09-16T03:47:43.197 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.192+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99505aba:::benchmark_data_smithi138_27857_object348:head, will try copies on 0,4 2024-09-16T03:47:43.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.196+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d6e05c:::benchmark_data_smithi138_27857_object4112:head, will try copies on 2,3 2024-09-16T03:47:43.203 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.196+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6528a7b8:::benchmark_data_smithi138_27857_object834:head, will try copies on 3,4 2024-09-16T03:47:43.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.212+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9644a253:::benchmark_data_smithi138_27857_object2149:head, will try copies on 0,4 2024-09-16T03:47:43.232 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.228+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:47:43.240 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.236+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2034240d:::benchmark_data_smithi138_27857_object1745:head, will try copies on 0,4 2024-09-16T03:47:43.271 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.264+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23adb93d:::benchmark_data_smithi138_27857_object340:head, will try copies on 0,4 2024-09-16T03:47:43.275 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.268+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:43.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.280+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a4d0f2:::benchmark_data_smithi138_27857_object3205:head, will try copies on 2,3 2024-09-16T03:47:43.299 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.292+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66cac094:::benchmark_data_smithi138_27857_object2805:head, will try copies on 3,4 2024-09-16T03:47:43.307 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5217984a:::benchmark_data_smithi138_27857_object3185:head, will try copies on 3,4 2024-09-16T03:47:43.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.308+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b00b43e:::benchmark_data_smithi138_27857_object533:head, will try copies on 0,4 2024-09-16T03:47:43.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.320+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:47:43.344 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.340+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8503e7:::benchmark_data_smithi138_27857_object1623:head, will try copies on 3,4 2024-09-16T03:47:43.364 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.356+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:47:43.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.364+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d60c78d:::benchmark_data_smithi138_27857_object580:head, will try copies on 0,4 2024-09-16T03:47:43.381 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.376+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e1c66b:::benchmark_data_smithi138_27857_object3274:head, will try copies on 2,3 2024-09-16T03:47:43.386 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.380+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3bd2d:::benchmark_data_smithi138_27857_object254:head, will try copies on 0,4 2024-09-16T03:47:43.389 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.384+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6228effa:::benchmark_data_smithi138_27857_object2124:head, will try copies on 3,4 2024-09-16T03:47:43.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.400+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:47:43.428 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.424+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff00e9f:::benchmark_data_smithi138_27857_object2929:head, will try copies on 2,3 2024-09-16T03:47:43.431 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.428+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1c6936:::benchmark_data_smithi138_27857_object1439:head, will try copies on 0,4 2024-09-16T03:47:43.432 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.428+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:996c3d44:::benchmark_data_smithi138_27857_object3563:head, will try copies on 0,4 2024-09-16T03:47:43.462 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.456+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b972fc73:::benchmark_data_smithi138_27857_object2023:head, will try copies on 2,3 2024-09-16T03:47:43.468 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.464+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1b5a92:::benchmark_data_smithi138_27857_object2567:head, will try copies on 0,4 2024-09-16T03:47:43.478 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.472+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e518f3:::benchmark_data_smithi138_27857_object1370:head, will try copies on 0,4 2024-09-16T03:47:43.498 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.492+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61eaaa23:::benchmark_data_smithi138_27857_object429:head, will try copies on 3,4 2024-09-16T03:47:43.509 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.504+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:47:43.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.512+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8067e:::benchmark_data_smithi138_27857_object4007:head, will try copies on 2,3 2024-09-16T03:47:43.534 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.528+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215356af:::benchmark_data_smithi138_27857_object2386:head, will try copies on 0,4 2024-09-16T03:47:43.535 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.532+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9761d5f6:::benchmark_data_smithi138_27857_object2913:head, will try copies on 0,4 2024-09-16T03:47:43.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.544+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1672921:::benchmark_data_smithi138_27857_object538:head, will try copies on 2,3 2024-09-16T03:47:43.555 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.548+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9edc67:::benchmark_data_smithi138_27857_object3330:head, will try copies on 0,4 2024-09-16T03:47:43.556 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.552+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650ef259:::benchmark_data_smithi138_27857_object2246:head, will try copies on 3,4 2024-09-16T03:47:43.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.576+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:47:43.615 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.612+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:47:43.645 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.640+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adf50bd:::benchmark_data_smithi138_27857_object1672:head, will try copies on 3,4 2024-09-16T03:47:43.653 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.648+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25eaef86:::benchmark_data_smithi138_27857_object2083:head, will try copies on 0,4 2024-09-16T03:47:43.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.676+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:252508c0:::benchmark_data_smithi138_27857_object1753:head, will try copies on 0,4 2024-09-16T03:47:43.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.696+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:47:43.713 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.708+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659ee651:::benchmark_data_smithi138_27857_object52:head, will try copies on 3,4 2024-09-16T03:47:43.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.716+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba17d5b3:::benchmark_data_smithi138_27857_object2169:head, will try copies on 2,3 2024-09-16T03:47:43.735 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.728+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a148627:::benchmark_data_smithi138_27857_object2278:head, will try copies on 0,4 2024-09-16T03:47:43.751 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.744+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd644df:::benchmark_data_smithi138_27857_object2723:head, will try copies on 2,3 2024-09-16T03:47:43.757 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.748+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:43.761 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.756+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a8d3d5c:::benchmark_data_smithi138_27857_object2609:head, will try copies on 3,4 2024-09-16T03:47:43.776 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.772+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64e8ff8a:::benchmark_data_smithi138_27857_object2421:head, will try copies on 3,4 2024-09-16T03:47:43.797 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.792+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bbe2c4d:::benchmark_data_smithi138_27857_object347:head, will try copies on 0,4 2024-09-16T03:47:43.799 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.792+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694e721b:::benchmark_data_smithi138_27857_object2699:head, will try copies on 3,4 2024-09-16T03:47:43.803 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.796+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949c9b8f:::benchmark_data_smithi138_27857_object2588:head, will try copies on 0,4 2024-09-16T03:47:43.820 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.816+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c8bd401:::benchmark_data_smithi138_27857_object3058:head, will try copies on 0,4 2024-09-16T03:47:43.829 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.824+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c7af43:::benchmark_data_smithi138_27857_object1994:head, will try copies on 2,3 2024-09-16T03:47:43.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.844+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6157ca53:::benchmark_data_smithi138_27857_object3648:head, will try copies on 3,4 2024-09-16T03:47:43.851 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.848+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba9fd135:::benchmark_data_smithi138_27857_object2415:head, will try copies on 2,3 2024-09-16T03:47:43.866 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.860+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:204e7b00:::benchmark_data_smithi138_27857_object1025:head, will try copies on 0,4 2024-09-16T03:47:43.867 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.860+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52662a74:::benchmark_data_smithi138_27857_object3770:head, will try copies on 3,4 2024-09-16T03:47:43.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.876+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6da4bc85:::benchmark_data_smithi138_27857_object1022:head, will try copies on 3,4 2024-09-16T03:47:43.881 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.876+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28300f77:::benchmark_data_smithi138_27857_object908:head, will try copies on 0,4 2024-09-16T03:47:43.888 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.884+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd056241:::benchmark_data_smithi138_27857_object831:head, will try copies on 2,3 2024-09-16T03:47:43.910 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.904+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:43.922 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.916+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b032ef:::benchmark_data_smithi138_27857_object757:head, will try copies on 3,4 2024-09-16T03:47:43.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.936+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6ff9ce:::benchmark_data_smithi138_27857_object1393:head, will try copies on 0,4 2024-09-16T03:47:43.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.948+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9635e927:::benchmark_data_smithi138_27857_object3597:head, will try copies on 0,4 2024-09-16T03:47:43.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.960+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569da3ed:::benchmark_data_smithi138_27857_object3404:head, will try copies on 3,4 2024-09-16T03:47:43.978 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.972+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6c47c8:::benchmark_data_smithi138_27857_object2643:head, will try copies on 0,4 2024-09-16T03:47:43.980 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.976+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8efed1:::benchmark_data_smithi138_27857_object3453:head, will try copies on 0,4 2024-09-16T03:47:43.996 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.992+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:967cff07:::benchmark_data_smithi138_27857_object2250:head, will try copies on 0,4 2024-09-16T03:47:44.000 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:43.996+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b63b6e7:::benchmark_data_smithi138_27857_object441:head, will try copies on 3,4 2024-09-16T03:47:44.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.004+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b845e7:::benchmark_data_smithi138_27857_object2793:head, will try copies on 0,4 2024-09-16T03:47:44.015 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:602966ad:::benchmark_data_smithi138_27857_object2433:head, will try copies on 3,4 2024-09-16T03:47:44.032 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.028+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:44.035 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.032+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9469cd7e:::benchmark_data_smithi138_27857_object313:head, will try copies on 0,4 2024-09-16T03:47:44.039 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.036+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65275066:::benchmark_data_smithi138_27857_object1670:head, will try copies on 3,4 2024-09-16T03:47:44.056 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.052+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:47:44.060 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.056+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555a163b:::benchmark_data_smithi138_27857_object3839:head, will try copies on 3,4 2024-09-16T03:47:44.069 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.064+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ee69dd:::benchmark_data_smithi138_27857_object955:head, will try copies on 2,3 2024-09-16T03:47:44.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.076+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9c6110:::benchmark_data_smithi138_27857_object3542:head, will try copies on 3,4 2024-09-16T03:47:44.092 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.088+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbadc6ce:::benchmark_data_smithi138_27857_object99:head, will try copies on 2,3 2024-09-16T03:47:44.103 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.096+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51b5aa55:::benchmark_data_smithi138_27857_object3640:head, will try copies on 3,4 2024-09-16T03:47:44.113 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.108+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdff3238:::benchmark_data_smithi138_27857_object619:head, will try copies on 2,3 2024-09-16T03:47:44.122 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.116+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:544aac52:::benchmark_data_smithi138_27857_object1585:head, will try copies on 3,4 2024-09-16T03:47:44.123 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.116+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cb136a:::benchmark_data_smithi138_27857_object1200:head, will try copies on 3,4 2024-09-16T03:47:44.156 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.152+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ae3891:::benchmark_data_smithi138_27857_object3041:head, will try copies on 3,4 2024-09-16T03:47:44.160 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.156+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4297de:::benchmark_data_smithi138_27857_object2534:head, will try copies on 3,4 2024-09-16T03:47:44.165 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.156+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900c2225:::benchmark_data_smithi138_27857_object3193:head, will try copies on 0,4 2024-09-16T03:47:44.171 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.164+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bca7abc1:::benchmark_data_smithi138_27857_object3761:head, will try copies on 2,3 2024-09-16T03:47:44.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 358 15 4587366 4587351 800.79 834.812 0.000701911 0.00123693 2024-09-16T03:47:44.193 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.188+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694a4a22:::benchmark_data_smithi138_27857_object3946:head, will try copies on 3,4 2024-09-16T03:47:44.202 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.196+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4e854c:::benchmark_data_smithi138_27857_object708:head, will try copies on 0,4 2024-09-16T03:47:44.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.208+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36c2d3f:::benchmark_data_smithi138_27857_object3595:head, will try copies on 2,3 2024-09-16T03:47:44.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.212+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530f1a06:::benchmark_data_smithi138_27857_object2888:head, will try copies on 3,4 2024-09-16T03:47:44.228 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.224+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3f3857:::benchmark_data_smithi138_27857_object3607:head, will try copies on 0,4 2024-09-16T03:47:44.262 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.256+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71b0173:::benchmark_data_smithi138_27857_object1729:head, will try copies on 2,3 2024-09-16T03:47:44.265 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.260+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c6ee197:::benchmark_data_smithi138_27857_object3473:head, will try copies on 0,4 2024-09-16T03:47:44.276 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.272+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58630459:::benchmark_data_smithi138_27857_object1969:head, will try copies on 3,4 2024-09-16T03:47:44.284 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.280+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:906662a4:::benchmark_data_smithi138_27857_object3528:head, will try copies on 0,4 2024-09-16T03:47:44.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.280+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b314da4f:::benchmark_data_smithi138_27857_object2742:head, will try copies on 2,3 2024-09-16T03:47:44.293 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.288+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24f3e9f3:::benchmark_data_smithi138_27857_object2110:head, will try copies on 0,4 2024-09-16T03:47:44.303 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.296+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc1f8be:::benchmark_data_smithi138_27857_object3244:head, will try copies on 3,4 2024-09-16T03:47:44.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.304+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5693f717:::benchmark_data_smithi138_27857_object909:head, will try copies on 3,4 2024-09-16T03:47:44.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.320+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:47:44.352 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.348+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:984e1a48:::benchmark_data_smithi138_27857_object3889:head, will try copies on 0,4 2024-09-16T03:47:44.370 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.360+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6addba16:::benchmark_data_smithi138_27857_object209:head, will try copies on 3,4 2024-09-16T03:47:44.373 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.368+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0d8cd48:::benchmark_data_smithi138_27857_object2822:head, will try copies on 2,3 2024-09-16T03:47:44.379 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.372+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d5aff9:::benchmark_data_smithi138_27857_object2736:head, will try copies on 0,4 2024-09-16T03:47:44.383 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.376+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c72a26:::benchmark_data_smithi138_27857_object3351:head, will try copies on 0,4 2024-09-16T03:47:44.399 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.396+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959ce6ab:::benchmark_data_smithi138_27857_object2517:head, will try copies on 0,4 2024-09-16T03:47:44.421 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.416+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5db76de4:::benchmark_data_smithi138_27857_object3685:head, will try copies on 3,4 2024-09-16T03:47:44.438 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.432+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:47:44.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.452+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2acf33b7:::benchmark_data_smithi138_27857_object1400:head, will try copies on 0,4 2024-09-16T03:47:44.463 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.456+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:44.474 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.468+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11bb17b:::benchmark_data_smithi138_27857_object3835:head, will try copies on 2,3 2024-09-16T03:47:44.485 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.480+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969151e7:::benchmark_data_smithi138_27857_object1624:head, will try copies on 0,4 2024-09-16T03:47:44.486 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.480+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233a0fb0:::benchmark_data_smithi138_27857_object2516:head, will try copies on 0,4 2024-09-16T03:47:44.495 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.492+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7e7d323:::benchmark_data_smithi138_27857_object3625:head, will try copies on 2,3 2024-09-16T03:47:44.518 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.512+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a1caf2:::benchmark_data_smithi138_27857_object596:head, will try copies on 0,4 2024-09-16T03:47:44.551 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.548+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6e0601:::benchmark_data_smithi138_27857_object2850:head, will try copies on 3,4 2024-09-16T03:47:44.552 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.548+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c7ecfa:::benchmark_data_smithi138_27857_object969:head, will try copies on 3,4 2024-09-16T03:47:44.572 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.568+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25568e11:::benchmark_data_smithi138_27857_object159:head, will try copies on 0,4 2024-09-16T03:47:44.575 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.568+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59929dd8:::benchmark_data_smithi138_27857_object2846:head, will try copies on 3,4 2024-09-16T03:47:44.582 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.576+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95c18fb8:::benchmark_data_smithi138_27857_object2118:head, will try copies on 0,4 2024-09-16T03:47:44.600 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.596+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd25642:::benchmark_data_smithi138_27857_object2972:head, will try copies on 2,3 2024-09-16T03:47:44.614 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.608+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d4f3c8:::benchmark_data_smithi138_27857_object250:head, will try copies on 3,4 2024-09-16T03:47:44.616 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.612+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2526bb14:::benchmark_data_smithi138_27857_object2111:head, will try copies on 0,4 2024-09-16T03:47:44.618 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.612+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e8a68b:::benchmark_data_smithi138_27857_object3384:head, will try copies on 2,3 2024-09-16T03:47:44.644 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.640+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfb2446:::benchmark_data_smithi138_27857_object94:head, will try copies on 3,4 2024-09-16T03:47:44.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.640+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:44.655 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.648+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7099a3:::benchmark_data_smithi138_27857_object3736:head, will try copies on 3,4 2024-09-16T03:47:44.700 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.696+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e391de0:::benchmark_data_smithi138_27857_object1608:head, will try copies on 3,4 2024-09-16T03:47:44.701 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.696+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:919ec65d:::benchmark_data_smithi138_27857_object609:head, will try copies on 0,4 2024-09-16T03:47:44.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.696+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223aa12d:::benchmark_data_smithi138_27857_object1796:head, will try copies on 0,4 2024-09-16T03:47:44.706 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.700+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673c676f:::benchmark_data_smithi138_27857_object501:head, will try copies on 3,4 2024-09-16T03:47:44.712 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.708+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbe1b76e:::benchmark_data_smithi138_27857_object2722:head, will try copies on 2,3 2024-09-16T03:47:44.739 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.732+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:285ffc64:::benchmark_data_smithi138_27857_object461:head, will try copies on 0,4 2024-09-16T03:47:44.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.760+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4374ba4:::benchmark_data_smithi138_27857_object1339:head, will try copies on 2,3 2024-09-16T03:47:44.767 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.760+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:47:44.768 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.764+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:44.809 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.804+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94db5db6:::benchmark_data_smithi138_27857_object3658:head, will try copies on 0,4 2024-09-16T03:47:44.815 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.808+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20e4cd21:::benchmark_data_smithi138_27857_object2639:head, will try copies on 0,4 2024-09-16T03:47:44.831 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.824+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bce639cf:::benchmark_data_smithi138_27857_object2287:head, will try copies on 2,3 2024-09-16T03:47:44.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.848+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116b264:::benchmark_data_smithi138_27857_object2495:head, will try copies on 2,3 2024-09-16T03:47:44.853 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.848+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3b6f44:::benchmark_data_smithi138_27857_object1603:head, will try copies on 0,4 2024-09-16T03:47:44.859 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.852+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:47:44.870 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.864+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58fc2afc:::benchmark_data_smithi138_27857_object431:head, will try copies on 3,4 2024-09-16T03:47:44.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.876+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74ed79f:::benchmark_data_smithi138_27857_object241:head, will try copies on 2,3 2024-09-16T03:47:44.909 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.904+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb1688a:::benchmark_data_smithi138_27857_object1635:head, will try copies on 3,4 2024-09-16T03:47:44.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.912+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9f754b4:::benchmark_data_smithi138_27857_object1482:head, will try copies on 2,3 2024-09-16T03:47:44.937 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.932+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa3f64:::benchmark_data_smithi138_27857_object1089:head, will try copies on 2,3 2024-09-16T03:47:44.941 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.936+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:276fe1eb:::benchmark_data_smithi138_27857_object1382:head, will try copies on 0,4 2024-09-16T03:47:44.946 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.940+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987e4aa3:::benchmark_data_smithi138_27857_object2637:head, will try copies on 0,4 2024-09-16T03:47:44.962 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.956+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7b1dc8:::benchmark_data_smithi138_27857_object3298:head, will try copies on 2,3 2024-09-16T03:47:44.965 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.960+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6286cc11:::benchmark_data_smithi138_27857_object2328:head, will try copies on 3,4 2024-09-16T03:47:44.969 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.964+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b892ef:::benchmark_data_smithi138_27857_object43:head, will try copies on 3,4 2024-09-16T03:47:44.975 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.968+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c53559:::benchmark_data_smithi138_27857_object2828:head, will try copies on 0,4 2024-09-16T03:47:44.979 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.972+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e2df0f:::benchmark_data_smithi138_27857_object3371:head, will try copies on 0,4 2024-09-16T03:47:44.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:44.984+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b21254:::benchmark_data_smithi138_27857_object672:head, will try copies on 2,3 2024-09-16T03:47:45.018 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.012+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67610095:::benchmark_data_smithi138_27857_object1788:head, will try copies on 3,4 2024-09-16T03:47:45.025 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.020+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a843962:::benchmark_data_smithi138_27857_object2440:head, will try copies on 0,4 2024-09-16T03:47:45.053 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.048+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63dde1d9:::benchmark_data_smithi138_27857_object2785:head, will try copies on 3,4 2024-09-16T03:47:45.062 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.056+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e5f33f2:::benchmark_data_smithi138_27857_object1232:head, will try copies on 3,4 2024-09-16T03:47:45.063 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.056+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9048286a:::benchmark_data_smithi138_27857_object2650:head, will try copies on 0,4 2024-09-16T03:47:45.083 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.076+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f1b1a4:::benchmark_data_smithi138_27857_object3164:head, will try copies on 0,4 2024-09-16T03:47:45.087 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.080+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d529416:::benchmark_data_smithi138_27857_object3455:head, will try copies on 3,4 2024-09-16T03:47:45.089 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.084+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523920b9:::benchmark_data_smithi138_27857_object70:head, will try copies on 3,4 2024-09-16T03:47:45.090 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.084+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997f49ba:::benchmark_data_smithi138_27857_object3465:head, will try copies on 0,4 2024-09-16T03:47:45.095 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.088+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e231ed:::benchmark_data_smithi138_27857_object1103:head, will try copies on 2,3 2024-09-16T03:47:45.133 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.128+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977114d5:::benchmark_data_smithi138_27857_object1880:head, will try copies on 0,4 2024-09-16T03:47:45.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.136+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b426b8:::benchmark_data_smithi138_27857_object1568:head, will try copies on 2,3 2024-09-16T03:47:45.159 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.152+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b646de96:::benchmark_data_smithi138_27857_object1297:head, will try copies on 2,3 2024-09-16T03:47:45.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.168+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93fc0f4f:::benchmark_data_smithi138_27857_object443:head, will try copies on 0,4 2024-09-16T03:47:45.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.168+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c15a81:::benchmark_data_smithi138_27857_object972:head, will try copies on 3,4 2024-09-16T03:47:45.174 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.168+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fda4301:::benchmark_data_smithi138_27857_object3068:head, will try copies on 0,4 2024-09-16T03:47:45.180 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.176+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a4d92:::benchmark_data_smithi138_27857_object2686:head, will try copies on 3,4 2024-09-16T03:47:45.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout: 359 16 4599872 4599856 800.736 781.562 0.000549101 0.00123701 2024-09-16T03:47:45.204 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.200+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5223680d:::benchmark_data_smithi138_27857_object1746:head, will try copies on 3,4 2024-09-16T03:47:45.215 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.208+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273e1664:::benchmark_data_smithi138_27857_object1245:head, will try copies on 0,4 2024-09-16T03:47:45.217 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.212+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6333f940:::benchmark_data_smithi138_27857_object2624:head, will try copies on 3,4 2024-09-16T03:47:45.218 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.212+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ecd75a:::benchmark_data_smithi138_27857_object3056:head, will try copies on 2,3 2024-09-16T03:47:45.245 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.240+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22893cd5:::benchmark_data_smithi138_27857_object3049:head, will try copies on 0,4 2024-09-16T03:47:45.249 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.244+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:951cf0a0:::benchmark_data_smithi138_27857_object928:head, will try copies on 0,4 2024-09-16T03:47:45.254 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.248+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58777c64:::benchmark_data_smithi138_27857_object2332:head, will try copies on 3,4 2024-09-16T03:47:45.274 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.268+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c4f6e:::benchmark_data_smithi138_27857_object3856:head, will try copies on 0,4 2024-09-16T03:47:45.279 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.276+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6a3458:::benchmark_data_smithi138_27857_object3739:head, will try copies on 2,3 2024-09-16T03:47:45.287 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.280+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:47:45.300 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.296+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ad98ca:::benchmark_data_smithi138_27857_object3847:head, will try copies on 2,3 2024-09-16T03:47:45.308 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.304+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916d6504:::benchmark_data_smithi138_27857_object3037:head, will try copies on 0,4 2024-09-16T03:47:45.315 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.308+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59775e4a:::benchmark_data_smithi138_27857_object2053:head, will try copies on 3,4 2024-09-16T03:47:45.319 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.312+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b568f29d:::benchmark_data_smithi138_27857_object3829:head, will try copies on 2,3 2024-09-16T03:47:45.321 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.316+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6162ff2a:::benchmark_data_smithi138_27857_object143:head, will try copies on 3,4 2024-09-16T03:47:45.326 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.320+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0fd973:::benchmark_data_smithi138_27857_object2886:head, will try copies on 0,4 2024-09-16T03:47:45.346 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.340+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbd1774a:::benchmark_data_smithi138_27857_object973:head, will try copies on 2,3 2024-09-16T03:47:45.396 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.392+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee010e1:::benchmark_data_smithi138_27857_object3671:head, will try copies on 0,4 2024-09-16T03:47:45.397 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.392+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe2cca7:::benchmark_data_smithi138_27857_object655:head, will try copies on 0,4 2024-09-16T03:47:45.404 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.400+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a26228:::benchmark_data_smithi138_27857_object1820:head, will try copies on 3,4 2024-09-16T03:47:45.425 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.420+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9185bfe6:::benchmark_data_smithi138_27857_object1283:head, will try copies on 0,4 2024-09-16T03:47:45.434 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.428+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a7163d:::benchmark_data_smithi138_27857_object2523:head, will try copies on 3,4 2024-09-16T03:47:45.443 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.436+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ebce9e:::benchmark_data_smithi138_27857_object2716:head, will try copies on 0,4 2024-09-16T03:47:45.456 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.452+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a070a1:::benchmark_data_smithi138_27857_object3536:head, will try copies on 3,4 2024-09-16T03:47:45.460 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.456+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958ef871:::benchmark_data_smithi138_27857_object3702:head, will try copies on 0,4 2024-09-16T03:47:45.471 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.464+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:45.489 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.484+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c605d96:::benchmark_data_smithi138_27857_object2770:head, will try copies on 0,4 2024-09-16T03:47:45.493 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.488+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3eaf4:::benchmark_data_smithi138_27857_object1913:head, will try copies on 3,4 2024-09-16T03:47:45.501 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.496+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52e995c6:::benchmark_data_smithi138_27857_object489:head, will try copies on 3,4 2024-09-16T03:47:45.503 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.496+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baf02a3f:::benchmark_data_smithi138_27857_object3186:head, will try copies on 2,3 2024-09-16T03:47:45.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.520+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d3ccd4:::benchmark_data_smithi138_27857_object2444:head, will try copies on 3,4 2024-09-16T03:47:45.527 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.524+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb67bc5:::benchmark_data_smithi138_27857_object2641:head, will try copies on 0,4 2024-09-16T03:47:45.548 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.544+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6810b8c5:::benchmark_data_smithi138_27857_object586:head, will try copies on 3,4 2024-09-16T03:47:45.549 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.544+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6684ba3:::benchmark_data_smithi138_27857_object3584:head, will try copies on 2,3 2024-09-16T03:47:45.560 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.556+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:955a02fc:::benchmark_data_smithi138_27857_object921:head, will try copies on 0,4 2024-09-16T03:47:45.570 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.564+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590c7931:::benchmark_data_smithi138_27857_object1725:head, will try copies on 3,4 2024-09-16T03:47:45.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.568+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c80fe9:::benchmark_data_smithi138_27857_object2620:head, will try copies on 2,3 2024-09-16T03:47:45.599 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.592+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5f9bfb:::benchmark_data_smithi138_27857_object4022:head, will try copies on 3,4 2024-09-16T03:47:45.613 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.608+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b96ef521:::benchmark_data_smithi138_27857_object369:head, will try copies on 2,3 2024-09-16T03:47:45.625 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.620+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519a898b:::benchmark_data_smithi138_27857_object3158:head, will try copies on 3,4 2024-09-16T03:47:45.628 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.624+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2054cadf:::benchmark_data_smithi138_27857_object231:head, will try copies on 0,4 2024-09-16T03:47:45.634 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.628+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef4eb44:::benchmark_data_smithi138_27857_object2936:head, will try copies on 2,3 2024-09-16T03:47:45.649 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.644+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cfc828:::benchmark_data_smithi138_27857_object2927:head, will try copies on 3,4 2024-09-16T03:47:45.663 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.656+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b85315a:::benchmark_data_smithi138_27857_object1049:head, will try copies on 3,4 2024-09-16T03:47:45.683 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.676+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688b147e:::benchmark_data_smithi138_27857_object2882:head, will try copies on 3,4 2024-09-16T03:47:45.686 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.680+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57754e6c:::benchmark_data_smithi138_27857_object65:head, will try copies on 3,4 2024-09-16T03:47:45.694 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.688+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938f91a6:::benchmark_data_smithi138_27857_object3918:head, will try copies on 0,4 2024-09-16T03:47:45.704 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.700+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beae14a7:::benchmark_data_smithi138_27857_object693:head, will try copies on 2,3 2024-09-16T03:47:45.722 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.716+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d714735:::benchmark_data_smithi138_27857_object679:head, will try copies on 3,4 2024-09-16T03:47:45.723 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.716+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6834b9b7:::benchmark_data_smithi138_27857_object32:head, will try copies on 3,4 2024-09-16T03:47:45.731 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.724+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183a014:::benchmark_data_smithi138_27857_object2921:head, will try copies on 2,3 2024-09-16T03:47:45.744 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.740+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9693ba91:::benchmark_data_smithi138_27857_object2298:head, will try copies on 0,4 2024-09-16T03:47:45.764 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.760+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fce9c49:::benchmark_data_smithi138_27857_object696:head, will try copies on 3,4 2024-09-16T03:47:45.770 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.764+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ee2a2cc:::benchmark_data_smithi138_27857_object3790:head, will try copies on 0,4 2024-09-16T03:47:45.774 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.768+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1e3b18:::benchmark_data_smithi138_27857_object2629:head, will try copies on 0,4 2024-09-16T03:47:45.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.780+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e1b7b27:::benchmark_data_smithi138_27857_object3253:head, will try copies on 3,4 2024-09-16T03:47:45.785 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.780+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670eeb36:::benchmark_data_smithi138_27857_object1876:head, will try copies on 3,4 2024-09-16T03:47:45.814 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.808+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:250e6ff2:::benchmark_data_smithi138_27857_object1204:head, will try copies on 0,4 2024-09-16T03:47:45.825 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.820+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bee1b7e:::benchmark_data_smithi138_27857_object2950:head, will try copies on 0,4 2024-09-16T03:47:45.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.836+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e9bc00:::benchmark_data_smithi138_27857_object3093:head, will try copies on 2,3 2024-09-16T03:47:45.847 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.844+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c7af565:::benchmark_data_smithi138_27857_object1346:head, will try copies on 0,4 2024-09-16T03:47:45.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.856+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:990151ac:::benchmark_data_smithi138_27857_object2530:head, will try copies on 0,4 2024-09-16T03:47:45.872 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.864+0000 7fdb39978640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:566b304f:::benchmark_data_smithi138_27857_object1076:head, will try copies on 3,4 2024-09-16T03:47:45.880 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.876+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a42b130:::benchmark_data_smithi138_27857_object987:head, will try copies on 0,4 2024-09-16T03:47:45.887 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.880+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f7593a:::benchmark_data_smithi138_27857_object3417:head, will try copies on 2,3 2024-09-16T03:47:45.892 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.888+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2729bb37:::benchmark_data_smithi138_27857_object3544:head, will try copies on 0,4 2024-09-16T03:47:45.940 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.936+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b09375e7:::benchmark_data_smithi138_27857_object3292:head, will try copies on 2,3 2024-09-16T03:47:45.950 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.944+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5472e2f7:::benchmark_data_smithi138_27857_object2294:head, will try copies on 3,4 2024-09-16T03:47:45.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.948+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e144fc:::benchmark_data_smithi138_27857_object710:head, will try copies on 3,4 2024-09-16T03:47:45.968 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.964+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f3f64f:::benchmark_data_smithi138_27857_object1919:head, will try copies on 0,4 2024-09-16T03:47:45.976 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.972+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b37a5231:::benchmark_data_smithi138_27857_object2542:head, will try copies on 2,3 2024-09-16T03:47:45.991 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.984+0000 7fdb3e181640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a71df18:::benchmark_data_smithi138_27857_object331:head, will try copies on 0,4 2024-09-16T03:47:46.003 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:45.996+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b086f817:::benchmark_data_smithi138_27857_object511:head, will try copies on 2,3 2024-09-16T03:47:46.005 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.000+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29eef756:::benchmark_data_smithi138_27857_object3124:head, will try copies on 0,4 2024-09-16T03:47:46.011 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.004+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:978487a6:::benchmark_data_smithi138_27857_object974:head, will try copies on 0,4 2024-09-16T03:47:46.036 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.032+0000 7fdb3d980640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b39ea2:::benchmark_data_smithi138_27857_object3365:head, will try copies on 3,4 2024-09-16T03:47:46.038 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.032+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeb31ed:::benchmark_data_smithi138_27857_object664:head, will try copies on 2,3 2024-09-16T03:47:46.052 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.048+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba2159d:::benchmark_data_smithi138_27857_object3125:head, will try copies on 0,4 2024-09-16T03:47:46.072 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.068+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613e3b60:::benchmark_data_smithi138_27857_object1534:head, will try copies on 3,4 2024-09-16T03:47:46.079 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.072+0000 7fdb3c97e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cd3b:::benchmark_data_smithi138_27857_object1527:head, will try copies on 0,4 2024-09-16T03:47:46.091 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.084+0000 7fdb3b97c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e0db5d:::benchmark_data_smithi138_27857_object2450:head, will try copies on 3,4 2024-09-16T03:47:46.098 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.092+0000 7fdb3c17d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e1e428:::benchmark_data_smithi138_27857_object2610:head, will try copies on 2,3 2024-09-16T03:47:46.101 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.096+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fdcd97:::benchmark_data_smithi138_27857_object2764:head, will try copies on 0,4 2024-09-16T03:47:46.112 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.108+0000 7fdb37974640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4e300c:::benchmark_data_smithi138_27857_object2379:head, will try copies on 3,4 2024-09-16T03:47:46.116 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.112+0000 7fdb38175640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f6e31b:::benchmark_data_smithi138_27857_object1094:head, will try copies on 2,3 2024-09-16T03:47:46.141 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.136+0000 7fdb3a179640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c521c9b:::benchmark_data_smithi138_27857_object2244:head, will try copies on 0,4 2024-09-16T03:47:46.146 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T03:47:46.140+0000 7fdb38976640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:233f987b:::benchmark_data_smithi138_27857_object1074:head, will try copies on 0,4 2024-09-16T03:47:46.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Total time run: 360.005 2024-09-16T03:47:46.186 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Total reads made: 4611973 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Read size: 65536 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Object size: 1048576 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Bandwidth (MB/sec): 800.68 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Average IOPS: 12810 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Stddev IOPS: 552.008 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Max IOPS: 13589 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Min IOPS: 10033 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Average Latency(s): 0.0012371 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Max latency(s): 0.141023 2024-09-16T03:47:46.187 INFO:tasks.radosbench.radosbench.0.smithi138.stdout:Min latency(s): 0.000222451 2024-09-16T03:47:46.341 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-16T03:47:46.342 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T03:47:46.342 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:47:46.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0' 2024-09-16T03:47:49.317 INFO:teuthology.orchestra.run.smithi138.stdout:{} 2024-09-16T03:47:49.318 INFO:teuthology.orchestra.run.smithi138.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T03:47:49.337 DEBUG:teuthology.orchestra.run.smithi138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0' 2024-09-16T03:47:49.491 INFO:teuthology.orchestra.run.smithi138.stdout:{} 2024-09-16T03:47:49.492 INFO:teuthology.orchestra.run.smithi138.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T03:47:49.509 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T03:47:49.522 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T03:47:49.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:47:53.795 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:47:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:47:53.812 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-16T03:47:52.002255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4330684459,"num_objects":4134,"num_object_clones":0,"num_object_copies":12400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66084,"num_write_kb":4229187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66085,"ondisk_log_size":66085,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1444688,"kb_used_data":794096,"kb_used_omap":9,"kb_used_meta":650486,"kb_avail":564786352,"statfs":{"total":579820584960,"available":578341224448,"internally_reserved":0,"allocated":813154304,"data_stored":12992425340,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":9568,"internal_metadata":666098336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-3,"num_objects_missing":0,"num_objects_degraded":-3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115917,"num_read_kb":7418688,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":845,"num_bytes_recovered":886046720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":845},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003272"},"pg_stats":[{"pgid":"2.f","version":"22'4096","reported_seq":290184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153551+0000","last_change":"2024-09-16T03:40:45.672195+0000","last_active":"2024-09-16T03:47:46.153551+0000","last_peered":"2024-09-16T03:47:46.153551+0000","last_clean":"2024-09-16T03:47:46.153551+0000","last_became_active":"2024-09-16T03:40:45.671214+0000","last_became_peered":"2024-09-16T03:40:45.671214+0000","last_unstale":"2024-09-16T03:47:46.153551+0000","last_undegraded":"2024-09-16T03:47:46.153551+0000","last_fullsized":"2024-09-16T03:47:46.153551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:24.356309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":286071,"num_read_kb":18308544,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"22'3776","reported_seq":267398,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151350+0000","last_change":"2024-09-16T03:40:45.671408+0000","last_active":"2024-09-16T03:47:46.151350+0000","last_peered":"2024-09-16T03:47:46.151350+0000","last_clean":"2024-09-16T03:47:46.151350+0000","last_became_active":"2024-09-16T03:40:45.670368+0000","last_became_peered":"2024-09-16T03:40:45.670368+0000","last_unstale":"2024-09-16T03:47:46.151350+0000","last_undegraded":"2024-09-16T03:47:46.151350+0000","last_fullsized":"2024-09-16T03:47:46.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:59.462308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":263605,"num_read_kb":16870720,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"22'4353","reported_seq":350840,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153229+0000","last_change":"2024-09-16T03:47:46.144582+0000","last_active":"2024-09-16T03:47:46.153229+0000","last_peered":"2024-09-16T03:47:46.153229+0000","last_clean":"2024-09-16T03:47:46.153229+0000","last_became_active":"2024-09-16T03:40:45.530928+0000","last_became_peered":"2024-09-16T03:40:45.530928+0000","last_unstale":"2024-09-16T03:47:46.153229+0000","last_undegraded":"2024-09-16T03:47:46.153229+0000","last_fullsized":"2024-09-16T03:47:46.153229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212696,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":303480,"num_read_kb":19422657,"num_write":4353,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6186,"num_bytes_recovered":6486491136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6186},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"22'4368","reported_seq":308836,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151302+0000","last_change":"2024-09-16T03:40:45.676915+0000","last_active":"2024-09-16T03:47:46.151302+0000","last_peered":"2024-09-16T03:47:46.151302+0000","last_clean":"2024-09-16T03:47:46.151302+0000","last_became_active":"2024-09-16T03:40:45.676022+0000","last_became_peered":"2024-09-16T03:40:45.676022+0000","last_unstale":"2024-09-16T03:47:46.151302+0000","last_undegraded":"2024-09-16T03:47:46.151302+0000","last_fullsized":"2024-09-16T03:47:46.151302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:42.783608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":304451,"num_read_kb":19484864,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"22'3584","reported_seq":253214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153683+0000","last_change":"2024-09-16T03:40:45.532568+0000","last_active":"2024-09-16T03:47:46.153683+0000","last_peered":"2024-09-16T03:47:46.153683+0000","last_clean":"2024-09-16T03:47:46.153683+0000","last_became_active":"2024-09-16T03:40:45.531890+0000","last_became_peered":"2024-09-16T03:40:45.531890+0000","last_unstale":"2024-09-16T03:47:46.153683+0000","last_undegraded":"2024-09-16T03:47:46.153683+0000","last_fullsized":"2024-09-16T03:47:46.153683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3584,"log_dups_size":0,"ondisk_log_size":3584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":249613,"num_read_kb":15975232,"num_write":3584,"num_write_kb":229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'4288","reported_seq":347267,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150491+0000","last_change":"2024-09-16T03:47:46.052369+0000","last_active":"2024-09-16T03:47:46.150491+0000","last_peered":"2024-09-16T03:47:46.150491+0000","last_clean":"2024-09-16T03:47:46.150491+0000","last_became_active":"2024-09-16T03:40:45.530920+0000","last_became_peered":"2024-09-16T03:40:45.530920+0000","last_unstale":"2024-09-16T03:47:46.150491+0000","last_undegraded":"2024-09-16T03:47:46.150491+0000","last_fullsized":"2024-09-16T03:47:46.150491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":300228,"num_read_kb":19214592,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":6448742400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6150},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"22'4576","reported_seq":369291,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153170+0000","last_change":"2024-09-16T03:47:46.152684+0000","last_active":"2024-09-16T03:47:46.153170+0000","last_peered":"2024-09-16T03:47:46.153170+0000","last_clean":"2024-09-16T03:47:46.153170+0000","last_became_active":"2024-09-16T03:40:45.670520+0000","last_became_peered":"2024-09-16T03:40:45.670520+0000","last_unstale":"2024-09-16T03:47:46.153170+0000","last_undegraded":"2024-09-16T03:47:46.153170+0000","last_fullsized":"2024-09-16T03:47:46.153170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":319451,"num_read_kb":20444864,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6523,"num_bytes_recovered":6839861248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6523},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"22'3840","reported_seq":271818,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151426+0000","last_change":"2024-09-16T03:40:45.677440+0000","last_active":"2024-09-16T03:47:46.151426+0000","last_peered":"2024-09-16T03:47:46.151426+0000","last_clean":"2024-09-16T03:47:46.151426+0000","last_became_active":"2024-09-16T03:40:45.676392+0000","last_became_peered":"2024-09-16T03:40:45.676392+0000","last_unstale":"2024-09-16T03:47:46.151426+0000","last_undegraded":"2024-09-16T03:47:46.151426+0000","last_fullsized":"2024-09-16T03:47:46.151426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3840,"log_dups_size":0,"ondisk_log_size":3840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":267961,"num_read_kb":17149504,"num_write":3840,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:37.028056+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:44:37.028056+0000","last_peered":"2024-09-16T03:44:37.028056+0000","last_clean":"2024-09-16T03:44:37.028056+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:44:37.028056+0000","last_undegraded":"2024-09-16T03:44:37.028056+0000","last_fullsized":"2024-09-16T03:44:37.028056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"22'4192","reported_seq":296331,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153690+0000","last_change":"2024-09-16T03:40:45.529111+0000","last_active":"2024-09-16T03:47:46.153690+0000","last_peered":"2024-09-16T03:47:46.153690+0000","last_clean":"2024-09-16T03:47:46.153690+0000","last_became_active":"2024-09-16T03:40:45.527941+0000","last_became_peered":"2024-09-16T03:40:45.527941+0000","last_unstale":"2024-09-16T03:47:46.153690+0000","last_undegraded":"2024-09-16T03:47:46.153690+0000","last_fullsized":"2024-09-16T03:47:46.153690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4192,"log_dups_size":0,"ondisk_log_size":4192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:45.862447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274726912,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":292122,"num_read_kb":18695808,"num_write":4192,"num_write_kb":268288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:47.974008+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:44:47.974008+0000","last_peered":"2024-09-16T03:44:47.974008+0000","last_clean":"2024-09-16T03:44:47.974008+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:44:47.974008+0000","last_undegraded":"2024-09-16T03:44:47.974008+0000","last_fullsized":"2024-09-16T03:44:47.974008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'4561","reported_seq":322664,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153910+0000","last_change":"2024-09-16T03:40:45.672119+0000","last_active":"2024-09-16T03:47:46.153910+0000","last_peered":"2024-09-16T03:47:46.153910+0000","last_clean":"2024-09-16T03:47:46.153910+0000","last_became_active":"2024-09-16T03:40:45.671114+0000","last_became_peered":"2024-09-16T03:40:45.671114+0000","last_unstale":"2024-09-16T03:47:46.153910+0000","last_undegraded":"2024-09-16T03:47:46.153910+0000","last_fullsized":"2024-09-16T03:47:46.153910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":318086,"num_read_kb":20357504,"num_write":4561,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"17'2","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978665+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:44:46.978665+0000","last_peered":"2024-09-16T03:44:46.978665+0000","last_clean":"2024-09-16T03:44:46.978665+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:44:46.978665+0000","last_undegraded":"2024-09-16T03:44:46.978665+0000","last_fullsized":"2024-09-16T03:44:46.978665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"22'4160","reported_seq":294744,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151052+0000","last_change":"2024-09-16T03:40:45.671718+0000","last_active":"2024-09-16T03:47:46.151052+0000","last_peered":"2024-09-16T03:47:46.151052+0000","last_clean":"2024-09-16T03:47:46.151052+0000","last_became_active":"2024-09-16T03:40:45.670429+0000","last_became_peered":"2024-09-16T03:40:45.670429+0000","last_unstale":"2024-09-16T03:47:46.151052+0000","last_undegraded":"2024-09-16T03:47:46.151052+0000","last_fullsized":"2024-09-16T03:47:46.151052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:02.362552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290567,"num_read_kb":18596288,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"15'1","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100369+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:44:46.100369+0000","last_peered":"2024-09-16T03:44:46.100369+0000","last_clean":"2024-09-16T03:44:46.100369+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:44:46.100369+0000","last_undegraded":"2024-09-16T03:44:46.100369+0000","last_fullsized":"2024-09-16T03:44:46.100369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'4160","reported_seq":294677,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.154091+0000","last_change":"2024-09-16T03:40:45.672213+0000","last_active":"2024-09-16T03:47:46.154091+0000","last_peered":"2024-09-16T03:47:46.154091+0000","last_clean":"2024-09-16T03:47:46.154091+0000","last_became_active":"2024-09-16T03:40:45.671244+0000","last_became_peered":"2024-09-16T03:40:45.671244+0000","last_unstale":"2024-09-16T03:47:46.154091+0000","last_undegraded":"2024-09-16T03:47:46.154091+0000","last_fullsized":"2024-09-16T03:47:46.154091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290500,"num_read_kb":18592000,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4112","reported_seq":291025,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151570+0000","last_change":"2024-09-16T03:40:45.536836+0000","last_active":"2024-09-16T03:47:46.151570+0000","last_peered":"2024-09-16T03:47:46.151570+0000","last_clean":"2024-09-16T03:47:46.151570+0000","last_became_active":"2024-09-16T03:40:45.532732+0000","last_became_peered":"2024-09-16T03:40:45.532732+0000","last_unstale":"2024-09-16T03:47:46.151570+0000","last_undegraded":"2024-09-16T03:47:46.151570+0000","last_fullsized":"2024-09-16T03:47:46.151570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4112,"log_dups_size":0,"ondisk_log_size":4112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:15.386280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":286896,"num_read_kb":18361344,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100398+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:44:46.100398+0000","last_peered":"2024-09-16T03:44:46.100398+0000","last_clean":"2024-09-16T03:44:46.100398+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:44:46.100398+0000","last_undegraded":"2024-09-16T03:44:46.100398+0000","last_fullsized":"2024-09-16T03:44:46.100398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4176","reported_seq":337689,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153146+0000","last_change":"2024-09-16T03:47:46.132832+0000","last_active":"2024-09-16T03:47:46.153146+0000","last_peered":"2024-09-16T03:47:46.153146+0000","last_clean":"2024-09-16T03:47:46.153146+0000","last_became_active":"2024-09-16T03:40:45.531058+0000","last_became_peered":"2024-09-16T03:40:45.531058+0000","last_unstale":"2024-09-16T03:47:46.153146+0000","last_undegraded":"2024-09-16T03:47:46.153146+0000","last_fullsized":"2024-09-16T03:47:46.153146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":291254,"num_read_kb":18640256,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6071,"num_bytes_recovered":6365904896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6071},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978687+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:44:46.978687+0000","last_peered":"2024-09-16T03:44:46.978687+0000","last_clean":"2024-09-16T03:44:46.978687+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:44:46.978687+0000","last_undegraded":"2024-09-16T03:44:46.978687+0000","last_fullsized":"2024-09-16T03:44:46.978687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"22'3936","reported_seq":278580,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150080+0000","last_change":"2024-09-16T03:40:45.677252+0000","last_active":"2024-09-16T03:47:46.150080+0000","last_peered":"2024-09-16T03:47:46.150080+0000","last_clean":"2024-09-16T03:47:46.150080+0000","last_became_active":"2024-09-16T03:40:45.676287+0000","last_became_peered":"2024-09-16T03:40:45.676287+0000","last_unstale":"2024-09-16T03:47:46.150080+0000","last_undegraded":"2024-09-16T03:47:46.150080+0000","last_fullsized":"2024-09-16T03:47:46.150080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3936,"log_dups_size":0,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257949696,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":246,"num_whiteouts":0,"num_read":274627,"num_read_kb":17576128,"num_write":3936,"num_write_kb":251904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.035112+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:44:57.035112+0000","last_peered":"2024-09-16T03:44:57.035112+0000","last_clean":"2024-09-16T03:44:57.035112+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:44:57.035112+0000","last_undegraded":"2024-09-16T03:44:57.035112+0000","last_fullsized":"2024-09-16T03:44:57.035112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.975727+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:44:57.975727+0000","last_peered":"2024-09-16T03:44:57.975727+0000","last_clean":"2024-09-16T03:44:57.975727+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:44:57.975727+0000","last_undegraded":"2024-09-16T03:44:57.975727+0000","last_fullsized":"2024-09-16T03:44:57.975727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"22'3904","reported_seq":317417,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.158280+0000","last_change":"2024-09-16T03:47:46.158634+0000","last_active":"2024-09-16T03:47:46.158280+0000","last_peered":"2024-09-16T03:47:46.158280+0000","last_clean":"2024-09-16T03:47:46.158280+0000","last_became_active":"2024-09-16T03:40:45.670556+0000","last_became_peered":"2024-09-16T03:40:45.670556+0000","last_unstale":"2024-09-16T03:47:46.158280+0000","last_undegraded":"2024-09-16T03:47:46.158280+0000","last_fullsized":"2024-09-16T03:47:46.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3904,"log_dups_size":0,"ondisk_log_size":3904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:41:58.644315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":0,"num_read":273062,"num_read_kb":17475968,"num_write":3904,"num_write_kb":249856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5810,"num_bytes_recovered":6092226560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5810},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4330684440,"num_objects":4132,"num_object_clones":0,"num_object_copies":12396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66082,"num_write_kb":4229185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812015616,"data_stored":12992053320,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":0,"internal_metadata":0},"log_size":66082,"ondisk_log_size":66082,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126348,"kb_used_data":81276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94245492,"statfs":{"total":96636764160,"available":96507383808,"internally_reserved":0,"allocated":83226624,"data_stored":1328673325,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640348,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206476,"kb_used_data":130876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94165364,"statfs":{"total":96636764160,"available":96425332736,"internally_reserved":0,"allocated":134017024,"data_stored":2141254208,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247820,"kb_used_data":162556,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94124020,"statfs":{"total":96636764160,"available":96382996480,"internally_reserved":0,"allocated":166457344,"data_stored":2660299333,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607642,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157580,"kb_used_data":100028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94214260,"statfs":{"total":96636764160,"available":96475402240,"internally_reserved":0,"allocated":102428672,"data_stored":1635840581,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455504,"kb_used_data":153664,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93916336,"statfs":{"total":96636764160,"available":96170328064,"internally_reserved":0,"allocated":157351936,"data_stored":2514612805,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":1595,"internal_metadata":309066181},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640348,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":165696,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":169672704,"data_stored":2711745088,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169480192,"data_stored":2711683072,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157163520,"data_stored":2514550808,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102240256,"data_stored":1635778584,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":166268928,"data_stored":2660237336,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133824512,"data_stored":2141192192,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83038208,"data_stored":1328611328,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:47:53.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:47:54.088 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:47:54.089 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:47:54.104 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-16T03:47:54.002993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4330684459,"num_objects":4134,"num_object_clones":0,"num_object_copies":12400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66084,"num_write_kb":4229187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66085,"ondisk_log_size":66085,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1444688,"kb_used_data":794096,"kb_used_omap":9,"kb_used_meta":650486,"kb_avail":564786352,"statfs":{"total":579820584960,"available":578341224448,"internally_reserved":0,"allocated":813154304,"data_stored":12992425340,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":9568,"internal_metadata":666098336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91529,"num_read_kb":5857856,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":435,"num_bytes_recovered":456130560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":435},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003623"},"pg_stats":[{"pgid":"2.f","version":"22'4096","reported_seq":290184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153551+0000","last_change":"2024-09-16T03:40:45.672195+0000","last_active":"2024-09-16T03:47:46.153551+0000","last_peered":"2024-09-16T03:47:46.153551+0000","last_clean":"2024-09-16T03:47:46.153551+0000","last_became_active":"2024-09-16T03:40:45.671214+0000","last_became_peered":"2024-09-16T03:40:45.671214+0000","last_unstale":"2024-09-16T03:47:46.153551+0000","last_undegraded":"2024-09-16T03:47:46.153551+0000","last_fullsized":"2024-09-16T03:47:46.153551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:24.356309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":286071,"num_read_kb":18308544,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"22'3776","reported_seq":267398,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151350+0000","last_change":"2024-09-16T03:40:45.671408+0000","last_active":"2024-09-16T03:47:46.151350+0000","last_peered":"2024-09-16T03:47:46.151350+0000","last_clean":"2024-09-16T03:47:46.151350+0000","last_became_active":"2024-09-16T03:40:45.670368+0000","last_became_peered":"2024-09-16T03:40:45.670368+0000","last_unstale":"2024-09-16T03:47:46.151350+0000","last_undegraded":"2024-09-16T03:47:46.151350+0000","last_fullsized":"2024-09-16T03:47:46.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:59.462308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":263605,"num_read_kb":16870720,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"22'4353","reported_seq":350840,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153229+0000","last_change":"2024-09-16T03:47:46.144582+0000","last_active":"2024-09-16T03:47:46.153229+0000","last_peered":"2024-09-16T03:47:46.153229+0000","last_clean":"2024-09-16T03:47:46.153229+0000","last_became_active":"2024-09-16T03:40:45.530928+0000","last_became_peered":"2024-09-16T03:40:45.530928+0000","last_unstale":"2024-09-16T03:47:46.153229+0000","last_undegraded":"2024-09-16T03:47:46.153229+0000","last_fullsized":"2024-09-16T03:47:46.153229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212696,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":303480,"num_read_kb":19422657,"num_write":4353,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6186,"num_bytes_recovered":6486491136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6186},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"22'4368","reported_seq":308836,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151302+0000","last_change":"2024-09-16T03:40:45.676915+0000","last_active":"2024-09-16T03:47:46.151302+0000","last_peered":"2024-09-16T03:47:46.151302+0000","last_clean":"2024-09-16T03:47:46.151302+0000","last_became_active":"2024-09-16T03:40:45.676022+0000","last_became_peered":"2024-09-16T03:40:45.676022+0000","last_unstale":"2024-09-16T03:47:46.151302+0000","last_undegraded":"2024-09-16T03:47:46.151302+0000","last_fullsized":"2024-09-16T03:47:46.151302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:42.783608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":304451,"num_read_kb":19484864,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"22'3584","reported_seq":253214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153683+0000","last_change":"2024-09-16T03:40:45.532568+0000","last_active":"2024-09-16T03:47:46.153683+0000","last_peered":"2024-09-16T03:47:46.153683+0000","last_clean":"2024-09-16T03:47:46.153683+0000","last_became_active":"2024-09-16T03:40:45.531890+0000","last_became_peered":"2024-09-16T03:40:45.531890+0000","last_unstale":"2024-09-16T03:47:46.153683+0000","last_undegraded":"2024-09-16T03:47:46.153683+0000","last_fullsized":"2024-09-16T03:47:46.153683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3584,"log_dups_size":0,"ondisk_log_size":3584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":249613,"num_read_kb":15975232,"num_write":3584,"num_write_kb":229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'4288","reported_seq":347267,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150491+0000","last_change":"2024-09-16T03:47:46.052369+0000","last_active":"2024-09-16T03:47:46.150491+0000","last_peered":"2024-09-16T03:47:46.150491+0000","last_clean":"2024-09-16T03:47:46.150491+0000","last_became_active":"2024-09-16T03:40:45.530920+0000","last_became_peered":"2024-09-16T03:40:45.530920+0000","last_unstale":"2024-09-16T03:47:46.150491+0000","last_undegraded":"2024-09-16T03:47:46.150491+0000","last_fullsized":"2024-09-16T03:47:46.150491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":300228,"num_read_kb":19214592,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":6448742400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6150},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"22'4576","reported_seq":369291,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153170+0000","last_change":"2024-09-16T03:47:46.152684+0000","last_active":"2024-09-16T03:47:46.153170+0000","last_peered":"2024-09-16T03:47:46.153170+0000","last_clean":"2024-09-16T03:47:46.153170+0000","last_became_active":"2024-09-16T03:40:45.670520+0000","last_became_peered":"2024-09-16T03:40:45.670520+0000","last_unstale":"2024-09-16T03:47:46.153170+0000","last_undegraded":"2024-09-16T03:47:46.153170+0000","last_fullsized":"2024-09-16T03:47:46.153170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":319451,"num_read_kb":20444864,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6523,"num_bytes_recovered":6839861248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6523},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"22'3840","reported_seq":271818,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151426+0000","last_change":"2024-09-16T03:40:45.677440+0000","last_active":"2024-09-16T03:47:46.151426+0000","last_peered":"2024-09-16T03:47:46.151426+0000","last_clean":"2024-09-16T03:47:46.151426+0000","last_became_active":"2024-09-16T03:40:45.676392+0000","last_became_peered":"2024-09-16T03:40:45.676392+0000","last_unstale":"2024-09-16T03:47:46.151426+0000","last_undegraded":"2024-09-16T03:47:46.151426+0000","last_fullsized":"2024-09-16T03:47:46.151426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3840,"log_dups_size":0,"ondisk_log_size":3840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":267961,"num_read_kb":17149504,"num_write":3840,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:37.028056+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:44:37.028056+0000","last_peered":"2024-09-16T03:44:37.028056+0000","last_clean":"2024-09-16T03:44:37.028056+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:44:37.028056+0000","last_undegraded":"2024-09-16T03:44:37.028056+0000","last_fullsized":"2024-09-16T03:44:37.028056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"22'4192","reported_seq":296331,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153690+0000","last_change":"2024-09-16T03:40:45.529111+0000","last_active":"2024-09-16T03:47:46.153690+0000","last_peered":"2024-09-16T03:47:46.153690+0000","last_clean":"2024-09-16T03:47:46.153690+0000","last_became_active":"2024-09-16T03:40:45.527941+0000","last_became_peered":"2024-09-16T03:40:45.527941+0000","last_unstale":"2024-09-16T03:47:46.153690+0000","last_undegraded":"2024-09-16T03:47:46.153690+0000","last_fullsized":"2024-09-16T03:47:46.153690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4192,"log_dups_size":0,"ondisk_log_size":4192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:45.862447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274726912,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":292122,"num_read_kb":18695808,"num_write":4192,"num_write_kb":268288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:47.974008+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:44:47.974008+0000","last_peered":"2024-09-16T03:44:47.974008+0000","last_clean":"2024-09-16T03:44:47.974008+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:44:47.974008+0000","last_undegraded":"2024-09-16T03:44:47.974008+0000","last_fullsized":"2024-09-16T03:44:47.974008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'4561","reported_seq":322664,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153910+0000","last_change":"2024-09-16T03:40:45.672119+0000","last_active":"2024-09-16T03:47:46.153910+0000","last_peered":"2024-09-16T03:47:46.153910+0000","last_clean":"2024-09-16T03:47:46.153910+0000","last_became_active":"2024-09-16T03:40:45.671114+0000","last_became_peered":"2024-09-16T03:40:45.671114+0000","last_unstale":"2024-09-16T03:47:46.153910+0000","last_undegraded":"2024-09-16T03:47:46.153910+0000","last_fullsized":"2024-09-16T03:47:46.153910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":318086,"num_read_kb":20357504,"num_write":4561,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"17'2","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978665+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:44:46.978665+0000","last_peered":"2024-09-16T03:44:46.978665+0000","last_clean":"2024-09-16T03:44:46.978665+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:44:46.978665+0000","last_undegraded":"2024-09-16T03:44:46.978665+0000","last_fullsized":"2024-09-16T03:44:46.978665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"22'4160","reported_seq":294744,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151052+0000","last_change":"2024-09-16T03:40:45.671718+0000","last_active":"2024-09-16T03:47:46.151052+0000","last_peered":"2024-09-16T03:47:46.151052+0000","last_clean":"2024-09-16T03:47:46.151052+0000","last_became_active":"2024-09-16T03:40:45.670429+0000","last_became_peered":"2024-09-16T03:40:45.670429+0000","last_unstale":"2024-09-16T03:47:46.151052+0000","last_undegraded":"2024-09-16T03:47:46.151052+0000","last_fullsized":"2024-09-16T03:47:46.151052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:02.362552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290567,"num_read_kb":18596288,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"15'1","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100369+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:44:46.100369+0000","last_peered":"2024-09-16T03:44:46.100369+0000","last_clean":"2024-09-16T03:44:46.100369+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:44:46.100369+0000","last_undegraded":"2024-09-16T03:44:46.100369+0000","last_fullsized":"2024-09-16T03:44:46.100369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'4160","reported_seq":294677,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.154091+0000","last_change":"2024-09-16T03:40:45.672213+0000","last_active":"2024-09-16T03:47:46.154091+0000","last_peered":"2024-09-16T03:47:46.154091+0000","last_clean":"2024-09-16T03:47:46.154091+0000","last_became_active":"2024-09-16T03:40:45.671244+0000","last_became_peered":"2024-09-16T03:40:45.671244+0000","last_unstale":"2024-09-16T03:47:46.154091+0000","last_undegraded":"2024-09-16T03:47:46.154091+0000","last_fullsized":"2024-09-16T03:47:46.154091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290500,"num_read_kb":18592000,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4112","reported_seq":291025,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151570+0000","last_change":"2024-09-16T03:40:45.536836+0000","last_active":"2024-09-16T03:47:46.151570+0000","last_peered":"2024-09-16T03:47:46.151570+0000","last_clean":"2024-09-16T03:47:46.151570+0000","last_became_active":"2024-09-16T03:40:45.532732+0000","last_became_peered":"2024-09-16T03:40:45.532732+0000","last_unstale":"2024-09-16T03:47:46.151570+0000","last_undegraded":"2024-09-16T03:47:46.151570+0000","last_fullsized":"2024-09-16T03:47:46.151570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4112,"log_dups_size":0,"ondisk_log_size":4112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:15.386280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":286896,"num_read_kb":18361344,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100398+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:44:46.100398+0000","last_peered":"2024-09-16T03:44:46.100398+0000","last_clean":"2024-09-16T03:44:46.100398+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:44:46.100398+0000","last_undegraded":"2024-09-16T03:44:46.100398+0000","last_fullsized":"2024-09-16T03:44:46.100398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4176","reported_seq":337689,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153146+0000","last_change":"2024-09-16T03:47:46.132832+0000","last_active":"2024-09-16T03:47:46.153146+0000","last_peered":"2024-09-16T03:47:46.153146+0000","last_clean":"2024-09-16T03:47:46.153146+0000","last_became_active":"2024-09-16T03:40:45.531058+0000","last_became_peered":"2024-09-16T03:40:45.531058+0000","last_unstale":"2024-09-16T03:47:46.153146+0000","last_undegraded":"2024-09-16T03:47:46.153146+0000","last_fullsized":"2024-09-16T03:47:46.153146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":291254,"num_read_kb":18640256,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6071,"num_bytes_recovered":6365904896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6071},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978687+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:44:46.978687+0000","last_peered":"2024-09-16T03:44:46.978687+0000","last_clean":"2024-09-16T03:44:46.978687+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:44:46.978687+0000","last_undegraded":"2024-09-16T03:44:46.978687+0000","last_fullsized":"2024-09-16T03:44:46.978687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"22'3936","reported_seq":278580,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150080+0000","last_change":"2024-09-16T03:40:45.677252+0000","last_active":"2024-09-16T03:47:46.150080+0000","last_peered":"2024-09-16T03:47:46.150080+0000","last_clean":"2024-09-16T03:47:46.150080+0000","last_became_active":"2024-09-16T03:40:45.676287+0000","last_became_peered":"2024-09-16T03:40:45.676287+0000","last_unstale":"2024-09-16T03:47:46.150080+0000","last_undegraded":"2024-09-16T03:47:46.150080+0000","last_fullsized":"2024-09-16T03:47:46.150080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3936,"log_dups_size":0,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257949696,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":246,"num_whiteouts":0,"num_read":274627,"num_read_kb":17576128,"num_write":3936,"num_write_kb":251904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.035112+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:44:57.035112+0000","last_peered":"2024-09-16T03:44:57.035112+0000","last_clean":"2024-09-16T03:44:57.035112+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:44:57.035112+0000","last_undegraded":"2024-09-16T03:44:57.035112+0000","last_fullsized":"2024-09-16T03:44:57.035112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.975727+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:44:57.975727+0000","last_peered":"2024-09-16T03:44:57.975727+0000","last_clean":"2024-09-16T03:44:57.975727+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:44:57.975727+0000","last_undegraded":"2024-09-16T03:44:57.975727+0000","last_fullsized":"2024-09-16T03:44:57.975727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"22'3904","reported_seq":317417,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.158280+0000","last_change":"2024-09-16T03:47:46.158634+0000","last_active":"2024-09-16T03:47:46.158280+0000","last_peered":"2024-09-16T03:47:46.158280+0000","last_clean":"2024-09-16T03:47:46.158280+0000","last_became_active":"2024-09-16T03:40:45.670556+0000","last_became_peered":"2024-09-16T03:40:45.670556+0000","last_unstale":"2024-09-16T03:47:46.158280+0000","last_undegraded":"2024-09-16T03:47:46.158280+0000","last_fullsized":"2024-09-16T03:47:46.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3904,"log_dups_size":0,"ondisk_log_size":3904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:41:58.644315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":0,"num_read":273062,"num_read_kb":17475968,"num_write":3904,"num_write_kb":249856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5810,"num_bytes_recovered":6092226560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5810},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4330684440,"num_objects":4132,"num_object_clones":0,"num_object_copies":12396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66082,"num_write_kb":4229185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812015616,"data_stored":12992053320,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":0,"internal_metadata":0},"log_size":66082,"ondisk_log_size":66082,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607644,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126348,"kb_used_data":81276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94245492,"statfs":{"total":96636764160,"available":96507383808,"internally_reserved":0,"allocated":83226624,"data_stored":1328673325,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640348,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206476,"kb_used_data":130876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94165364,"statfs":{"total":96636764160,"available":96425332736,"internally_reserved":0,"allocated":134017024,"data_stored":2141254208,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640348,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247820,"kb_used_data":162556,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94124020,"statfs":{"total":96636764160,"available":96382996480,"internally_reserved":0,"allocated":166457344,"data_stored":2660299333,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157580,"kb_used_data":100028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94214260,"statfs":{"total":96636764160,"available":96475402240,"internally_reserved":0,"allocated":102428672,"data_stored":1635840581,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455504,"kb_used_data":153664,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93916336,"statfs":{"total":96636764160,"available":96170328064,"internally_reserved":0,"allocated":157351936,"data_stored":2514612805,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":1595,"internal_metadata":309066181},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640348,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":165696,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":169672704,"data_stored":2711745088,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169480192,"data_stored":2711683072,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157163520,"data_stored":2514550808,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102240256,"data_stored":1635778584,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":166268928,"data_stored":2660237336,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133824512,"data_stored":2141192192,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83038208,"data_stored":1328611328,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:47:54.105 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T03:47:54.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:47:54.385 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:47:54.386 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:47:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-16T03:47:54.002993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4330684459,"num_objects":4134,"num_object_clones":0,"num_object_copies":12400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66084,"num_write_kb":4229187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66085,"ondisk_log_size":66085,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1444688,"kb_used_data":794096,"kb_used_omap":9,"kb_used_meta":650486,"kb_avail":564786352,"statfs":{"total":579820584960,"available":578341224448,"internally_reserved":0,"allocated":813154304,"data_stored":12992425340,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":9568,"internal_metadata":666098336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91529,"num_read_kb":5857856,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":435,"num_bytes_recovered":456130560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":435},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003623"},"pg_stats":[{"pgid":"2.f","version":"22'4096","reported_seq":290184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153551+0000","last_change":"2024-09-16T03:40:45.672195+0000","last_active":"2024-09-16T03:47:46.153551+0000","last_peered":"2024-09-16T03:47:46.153551+0000","last_clean":"2024-09-16T03:47:46.153551+0000","last_became_active":"2024-09-16T03:40:45.671214+0000","last_became_peered":"2024-09-16T03:40:45.671214+0000","last_unstale":"2024-09-16T03:47:46.153551+0000","last_undegraded":"2024-09-16T03:47:46.153551+0000","last_fullsized":"2024-09-16T03:47:46.153551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:24.356309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":286071,"num_read_kb":18308544,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"22'3776","reported_seq":267398,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151350+0000","last_change":"2024-09-16T03:40:45.671408+0000","last_active":"2024-09-16T03:47:46.151350+0000","last_peered":"2024-09-16T03:47:46.151350+0000","last_clean":"2024-09-16T03:47:46.151350+0000","last_became_active":"2024-09-16T03:40:45.670368+0000","last_became_peered":"2024-09-16T03:40:45.670368+0000","last_unstale":"2024-09-16T03:47:46.151350+0000","last_undegraded":"2024-09-16T03:47:46.151350+0000","last_fullsized":"2024-09-16T03:47:46.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:59.462308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":263605,"num_read_kb":16870720,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"22'4353","reported_seq":350840,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153229+0000","last_change":"2024-09-16T03:47:46.144582+0000","last_active":"2024-09-16T03:47:46.153229+0000","last_peered":"2024-09-16T03:47:46.153229+0000","last_clean":"2024-09-16T03:47:46.153229+0000","last_became_active":"2024-09-16T03:40:45.530928+0000","last_became_peered":"2024-09-16T03:40:45.530928+0000","last_unstale":"2024-09-16T03:47:46.153229+0000","last_undegraded":"2024-09-16T03:47:46.153229+0000","last_fullsized":"2024-09-16T03:47:46.153229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212696,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":303480,"num_read_kb":19422657,"num_write":4353,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6186,"num_bytes_recovered":6486491136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6186},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"22'4368","reported_seq":308836,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151302+0000","last_change":"2024-09-16T03:40:45.676915+0000","last_active":"2024-09-16T03:47:46.151302+0000","last_peered":"2024-09-16T03:47:46.151302+0000","last_clean":"2024-09-16T03:47:46.151302+0000","last_became_active":"2024-09-16T03:40:45.676022+0000","last_became_peered":"2024-09-16T03:40:45.676022+0000","last_unstale":"2024-09-16T03:47:46.151302+0000","last_undegraded":"2024-09-16T03:47:46.151302+0000","last_fullsized":"2024-09-16T03:47:46.151302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:42.783608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":304451,"num_read_kb":19484864,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"22'3584","reported_seq":253214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153683+0000","last_change":"2024-09-16T03:40:45.532568+0000","last_active":"2024-09-16T03:47:46.153683+0000","last_peered":"2024-09-16T03:47:46.153683+0000","last_clean":"2024-09-16T03:47:46.153683+0000","last_became_active":"2024-09-16T03:40:45.531890+0000","last_became_peered":"2024-09-16T03:40:45.531890+0000","last_unstale":"2024-09-16T03:47:46.153683+0000","last_undegraded":"2024-09-16T03:47:46.153683+0000","last_fullsized":"2024-09-16T03:47:46.153683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3584,"log_dups_size":0,"ondisk_log_size":3584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":249613,"num_read_kb":15975232,"num_write":3584,"num_write_kb":229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'4288","reported_seq":347267,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150491+0000","last_change":"2024-09-16T03:47:46.052369+0000","last_active":"2024-09-16T03:47:46.150491+0000","last_peered":"2024-09-16T03:47:46.150491+0000","last_clean":"2024-09-16T03:47:46.150491+0000","last_became_active":"2024-09-16T03:40:45.530920+0000","last_became_peered":"2024-09-16T03:40:45.530920+0000","last_unstale":"2024-09-16T03:47:46.150491+0000","last_undegraded":"2024-09-16T03:47:46.150491+0000","last_fullsized":"2024-09-16T03:47:46.150491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":300228,"num_read_kb":19214592,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":6448742400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6150},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"22'4576","reported_seq":369291,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153170+0000","last_change":"2024-09-16T03:47:46.152684+0000","last_active":"2024-09-16T03:47:46.153170+0000","last_peered":"2024-09-16T03:47:46.153170+0000","last_clean":"2024-09-16T03:47:46.153170+0000","last_became_active":"2024-09-16T03:40:45.670520+0000","last_became_peered":"2024-09-16T03:40:45.670520+0000","last_unstale":"2024-09-16T03:47:46.153170+0000","last_undegraded":"2024-09-16T03:47:46.153170+0000","last_fullsized":"2024-09-16T03:47:46.153170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":319451,"num_read_kb":20444864,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6523,"num_bytes_recovered":6839861248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6523},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"22'3840","reported_seq":271818,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151426+0000","last_change":"2024-09-16T03:40:45.677440+0000","last_active":"2024-09-16T03:47:46.151426+0000","last_peered":"2024-09-16T03:47:46.151426+0000","last_clean":"2024-09-16T03:47:46.151426+0000","last_became_active":"2024-09-16T03:40:45.676392+0000","last_became_peered":"2024-09-16T03:40:45.676392+0000","last_unstale":"2024-09-16T03:47:46.151426+0000","last_undegraded":"2024-09-16T03:47:46.151426+0000","last_fullsized":"2024-09-16T03:47:46.151426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3840,"log_dups_size":0,"ondisk_log_size":3840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":267961,"num_read_kb":17149504,"num_write":3840,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:37.028056+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:44:37.028056+0000","last_peered":"2024-09-16T03:44:37.028056+0000","last_clean":"2024-09-16T03:44:37.028056+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:44:37.028056+0000","last_undegraded":"2024-09-16T03:44:37.028056+0000","last_fullsized":"2024-09-16T03:44:37.028056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"22'4192","reported_seq":296331,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153690+0000","last_change":"2024-09-16T03:40:45.529111+0000","last_active":"2024-09-16T03:47:46.153690+0000","last_peered":"2024-09-16T03:47:46.153690+0000","last_clean":"2024-09-16T03:47:46.153690+0000","last_became_active":"2024-09-16T03:40:45.527941+0000","last_became_peered":"2024-09-16T03:40:45.527941+0000","last_unstale":"2024-09-16T03:47:46.153690+0000","last_undegraded":"2024-09-16T03:47:46.153690+0000","last_fullsized":"2024-09-16T03:47:46.153690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4192,"log_dups_size":0,"ondisk_log_size":4192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:45.862447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274726912,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":292122,"num_read_kb":18695808,"num_write":4192,"num_write_kb":268288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:47.974008+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:44:47.974008+0000","last_peered":"2024-09-16T03:44:47.974008+0000","last_clean":"2024-09-16T03:44:47.974008+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:44:47.974008+0000","last_undegraded":"2024-09-16T03:44:47.974008+0000","last_fullsized":"2024-09-16T03:44:47.974008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'4561","reported_seq":322664,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153910+0000","last_change":"2024-09-16T03:40:45.672119+0000","last_active":"2024-09-16T03:47:46.153910+0000","last_peered":"2024-09-16T03:47:46.153910+0000","last_clean":"2024-09-16T03:47:46.153910+0000","last_became_active":"2024-09-16T03:40:45.671114+0000","last_became_peered":"2024-09-16T03:40:45.671114+0000","last_unstale":"2024-09-16T03:47:46.153910+0000","last_undegraded":"2024-09-16T03:47:46.153910+0000","last_fullsized":"2024-09-16T03:47:46.153910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":318086,"num_read_kb":20357504,"num_write":4561,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"17'2","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978665+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:44:46.978665+0000","last_peered":"2024-09-16T03:44:46.978665+0000","last_clean":"2024-09-16T03:44:46.978665+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:44:46.978665+0000","last_undegraded":"2024-09-16T03:44:46.978665+0000","last_fullsized":"2024-09-16T03:44:46.978665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"22'4160","reported_seq":294744,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151052+0000","last_change":"2024-09-16T03:40:45.671718+0000","last_active":"2024-09-16T03:47:46.151052+0000","last_peered":"2024-09-16T03:47:46.151052+0000","last_clean":"2024-09-16T03:47:46.151052+0000","last_became_active":"2024-09-16T03:40:45.670429+0000","last_became_peered":"2024-09-16T03:40:45.670429+0000","last_unstale":"2024-09-16T03:47:46.151052+0000","last_undegraded":"2024-09-16T03:47:46.151052+0000","last_fullsized":"2024-09-16T03:47:46.151052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:02.362552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290567,"num_read_kb":18596288,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"15'1","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100369+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:44:46.100369+0000","last_peered":"2024-09-16T03:44:46.100369+0000","last_clean":"2024-09-16T03:44:46.100369+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:44:46.100369+0000","last_undegraded":"2024-09-16T03:44:46.100369+0000","last_fullsized":"2024-09-16T03:44:46.100369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'4160","reported_seq":294677,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.154091+0000","last_change":"2024-09-16T03:40:45.672213+0000","last_active":"2024-09-16T03:47:46.154091+0000","last_peered":"2024-09-16T03:47:46.154091+0000","last_clean":"2024-09-16T03:47:46.154091+0000","last_became_active":"2024-09-16T03:40:45.671244+0000","last_became_peered":"2024-09-16T03:40:45.671244+0000","last_unstale":"2024-09-16T03:47:46.154091+0000","last_undegraded":"2024-09-16T03:47:46.154091+0000","last_fullsized":"2024-09-16T03:47:46.154091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290500,"num_read_kb":18592000,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4112","reported_seq":291025,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151570+0000","last_change":"2024-09-16T03:40:45.536836+0000","last_active":"2024-09-16T03:47:46.151570+0000","last_peered":"2024-09-16T03:47:46.151570+0000","last_clean":"2024-09-16T03:47:46.151570+0000","last_became_active":"2024-09-16T03:40:45.532732+0000","last_became_peered":"2024-09-16T03:40:45.532732+0000","last_unstale":"2024-09-16T03:47:46.151570+0000","last_undegraded":"2024-09-16T03:47:46.151570+0000","last_fullsized":"2024-09-16T03:47:46.151570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4112,"log_dups_size":0,"ondisk_log_size":4112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:15.386280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":286896,"num_read_kb":18361344,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100398+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:44:46.100398+0000","last_peered":"2024-09-16T03:44:46.100398+0000","last_clean":"2024-09-16T03:44:46.100398+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:44:46.100398+0000","last_undegraded":"2024-09-16T03:44:46.100398+0000","last_fullsized":"2024-09-16T03:44:46.100398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4176","reported_seq":337689,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153146+0000","last_change":"2024-09-16T03:47:46.132832+0000","last_active":"2024-09-16T03:47:46.153146+0000","last_peered":"2024-09-16T03:47:46.153146+0000","last_clean":"2024-09-16T03:47:46.153146+0000","last_became_active":"2024-09-16T03:40:45.531058+0000","last_became_peered":"2024-09-16T03:40:45.531058+0000","last_unstale":"2024-09-16T03:47:46.153146+0000","last_undegraded":"2024-09-16T03:47:46.153146+0000","last_fullsized":"2024-09-16T03:47:46.153146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":291254,"num_read_kb":18640256,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6071,"num_bytes_recovered":6365904896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6071},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978687+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:44:46.978687+0000","last_peered":"2024-09-16T03:44:46.978687+0000","last_clean":"2024-09-16T03:44:46.978687+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:44:46.978687+0000","last_undegraded":"2024-09-16T03:44:46.978687+0000","last_fullsized":"2024-09-16T03:44:46.978687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"22'3936","reported_seq":278580,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150080+0000","last_change":"2024-09-16T03:40:45.677252+0000","last_active":"2024-09-16T03:47:46.150080+0000","last_peered":"2024-09-16T03:47:46.150080+0000","last_clean":"2024-09-16T03:47:46.150080+0000","last_became_active":"2024-09-16T03:40:45.676287+0000","last_became_peered":"2024-09-16T03:40:45.676287+0000","last_unstale":"2024-09-16T03:47:46.150080+0000","last_undegraded":"2024-09-16T03:47:46.150080+0000","last_fullsized":"2024-09-16T03:47:46.150080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3936,"log_dups_size":0,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257949696,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":246,"num_whiteouts":0,"num_read":274627,"num_read_kb":17576128,"num_write":3936,"num_write_kb":251904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.035112+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:44:57.035112+0000","last_peered":"2024-09-16T03:44:57.035112+0000","last_clean":"2024-09-16T03:44:57.035112+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:44:57.035112+0000","last_undegraded":"2024-09-16T03:44:57.035112+0000","last_fullsized":"2024-09-16T03:44:57.035112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.975727+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:44:57.975727+0000","last_peered":"2024-09-16T03:44:57.975727+0000","last_clean":"2024-09-16T03:44:57.975727+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:44:57.975727+0000","last_undegraded":"2024-09-16T03:44:57.975727+0000","last_fullsized":"2024-09-16T03:44:57.975727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"22'3904","reported_seq":317417,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.158280+0000","last_change":"2024-09-16T03:47:46.158634+0000","last_active":"2024-09-16T03:47:46.158280+0000","last_peered":"2024-09-16T03:47:46.158280+0000","last_clean":"2024-09-16T03:47:46.158280+0000","last_became_active":"2024-09-16T03:40:45.670556+0000","last_became_peered":"2024-09-16T03:40:45.670556+0000","last_unstale":"2024-09-16T03:47:46.158280+0000","last_undegraded":"2024-09-16T03:47:46.158280+0000","last_fullsized":"2024-09-16T03:47:46.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3904,"log_dups_size":0,"ondisk_log_size":3904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:41:58.644315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":0,"num_read":273062,"num_read_kb":17475968,"num_write":3904,"num_write_kb":249856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5810,"num_bytes_recovered":6092226560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5810},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4330684440,"num_objects":4132,"num_object_clones":0,"num_object_copies":12396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66082,"num_write_kb":4229185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812015616,"data_stored":12992053320,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":0,"internal_metadata":0},"log_size":66082,"ondisk_log_size":66082,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607644,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126348,"kb_used_data":81276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94245492,"statfs":{"total":96636764160,"available":96507383808,"internally_reserved":0,"allocated":83226624,"data_stored":1328673325,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640348,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206476,"kb_used_data":130876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94165364,"statfs":{"total":96636764160,"available":96425332736,"internally_reserved":0,"allocated":134017024,"data_stored":2141254208,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640348,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247820,"kb_used_data":162556,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94124020,"statfs":{"total":96636764160,"available":96382996480,"internally_reserved":0,"allocated":166457344,"data_stored":2660299333,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157580,"kb_used_data":100028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94214260,"statfs":{"total":96636764160,"available":96475402240,"internally_reserved":0,"allocated":102428672,"data_stored":1635840581,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455504,"kb_used_data":153664,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93916336,"statfs":{"total":96636764160,"available":96170328064,"internally_reserved":0,"allocated":157351936,"data_stored":2514612805,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":1595,"internal_metadata":309066181},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640348,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":165696,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":169672704,"data_stored":2711745088,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169480192,"data_stored":2711683072,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157163520,"data_stored":2514550808,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102240256,"data_stored":1635778584,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":166268928,"data_stored":2660237336,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133824512,"data_stored":2141192192,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83038208,"data_stored":1328611328,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:47:54.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T03:47:54.670 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:47:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"fsid":"5ce79052-9b5c-4295-9224-2993bbcd9fb9","created":"2024-09-16T03:40:16.547946+0000","modified":"2024-09-16T03:40:46.518401+0000","last_up_change":"2024-09-16T03:40:26.929108+0000","last_in_change":"2024-09-16T03:40:18.409863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T03:40:33.592384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"test","create_time":"2024-09-16T03:40:42.935848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc723b38-7dda-4324-b461-72f7a23622b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":3688580009}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":3688580009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":3688580009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":3688580009}]},"public_addr":"172.21.15.73:6800/3688580009","cluster_addr":"172.21.15.73:6801/3688580009","heartbeat_back_addr":"172.21.15.73:6803/3688580009","heartbeat_front_addr":"172.21.15.73:6802/3688580009","state":["exists","up"]},{"osd":1,"uuid":"b17eb455-f200-4546-b9ac-f41f7f9be2a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":1689880506}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":1689880506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":1689880506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":1689880506}]},"public_addr":"172.21.15.73:6804/1689880506","cluster_addr":"172.21.15.73:6805/1689880506","heartbeat_back_addr":"172.21.15.73:6807/1689880506","heartbeat_front_addr":"172.21.15.73:6806/1689880506","state":["exists","up"]},{"osd":2,"uuid":"1a7e2927-e459-494a-a8c0-9ab5907f527d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":754981219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":754981219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":754981219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":754981219}]},"public_addr":"172.21.15.73:6808/754981219","cluster_addr":"172.21.15.73:6809/754981219","heartbeat_back_addr":"172.21.15.73:6811/754981219","heartbeat_front_addr":"172.21.15.73:6810/754981219","state":["exists","up"]},{"osd":3,"uuid":"42ff12dc-8175-4cc9-a53e-c6181f51893d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":1591405063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":1591405063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":1591405063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":1591405063}]},"public_addr":"172.21.15.138:6808/1591405063","cluster_addr":"172.21.15.138:6809/1591405063","heartbeat_back_addr":"172.21.15.138:6811/1591405063","heartbeat_front_addr":"172.21.15.138:6810/1591405063","state":["exists","up"]},{"osd":4,"uuid":"aacddc43-13b4-40df-8318-235cda520717","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":2286792550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":2286792550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":2286792550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":2286792550}]},"public_addr":"172.21.15.138:6800/2286792550","cluster_addr":"172.21.15.138:6801/2286792550","heartbeat_back_addr":"172.21.15.138:6803/2286792550","heartbeat_front_addr":"172.21.15.138:6802/2286792550","state":["exists","up"]},{"osd":5,"uuid":"f4239c62-4940-435b-9aaf-0f42da29d537","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":2313720468}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":2313720468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":2313720468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":2313720468}]},"public_addr":"172.21.15.138:6804/2313720468","cluster_addr":"172.21.15.138:6805/2313720468","heartbeat_back_addr":"172.21.15.138:6807/2313720468","heartbeat_front_addr":"172.21.15.138:6806/2313720468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.641381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.871959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:25.131075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.712196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.442534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T03:40:24.997771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:47:55.687 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T03:47:55.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:55.841 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:55.841 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:55.841 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:55.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T03:47:56.129 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T03:47:56.146 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T03:47:56.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:56.289 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:56.289 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:56.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T03:47:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T03:47:56.586 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T03:47:56.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:56.729 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:56.730 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:56.730 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:56.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T03:47:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T03:47:57.022 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T03:47:57.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:57.170 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:57.171 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:57.171 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:57.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T03:47:57.505 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T03:47:57.523 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T03:47:57.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:57.687 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:57.687 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:57.688 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:57.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T03:47:58.043 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T03:47:58.063 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T03:47:58.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T03:47:58.253 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T03:47:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T03:47:58.253 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T03:47:58.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T03:47:58.657 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T03:47:58.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:47:58.992 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:47:58.993 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:47:59.007 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-16T03:47:58.003913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4330684459,"num_objects":4134,"num_object_clones":0,"num_object_copies":12400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66084,"num_write_kb":4229187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66085,"ondisk_log_size":66085,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1444688,"kb_used_data":794096,"kb_used_omap":9,"kb_used_meta":650486,"kb_avail":564786352,"statfs":{"total":579820584960,"available":578341224448,"internally_reserved":0,"allocated":813154304,"data_stored":12992425340,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":9568,"internal_metadata":666098336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52695,"num_read_kb":3372480,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":435,"num_bytes_recovered":456130560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":435},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003676"},"pg_stats":[{"pgid":"2.f","version":"22'4096","reported_seq":290184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153551+0000","last_change":"2024-09-16T03:40:45.672195+0000","last_active":"2024-09-16T03:47:46.153551+0000","last_peered":"2024-09-16T03:47:46.153551+0000","last_clean":"2024-09-16T03:47:46.153551+0000","last_became_active":"2024-09-16T03:40:45.671214+0000","last_became_peered":"2024-09-16T03:40:45.671214+0000","last_unstale":"2024-09-16T03:47:46.153551+0000","last_undegraded":"2024-09-16T03:47:46.153551+0000","last_fullsized":"2024-09-16T03:47:46.153551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:24.356309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":286071,"num_read_kb":18308544,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"22'3776","reported_seq":267398,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151350+0000","last_change":"2024-09-16T03:40:45.671408+0000","last_active":"2024-09-16T03:47:46.151350+0000","last_peered":"2024-09-16T03:47:46.151350+0000","last_clean":"2024-09-16T03:47:46.151350+0000","last_became_active":"2024-09-16T03:40:45.670368+0000","last_became_peered":"2024-09-16T03:40:45.670368+0000","last_unstale":"2024-09-16T03:47:46.151350+0000","last_undegraded":"2024-09-16T03:47:46.151350+0000","last_fullsized":"2024-09-16T03:47:46.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:59.462308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":263605,"num_read_kb":16870720,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"22'4353","reported_seq":350840,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153229+0000","last_change":"2024-09-16T03:47:46.144582+0000","last_active":"2024-09-16T03:47:46.153229+0000","last_peered":"2024-09-16T03:47:46.153229+0000","last_clean":"2024-09-16T03:47:46.153229+0000","last_became_active":"2024-09-16T03:40:45.530928+0000","last_became_peered":"2024-09-16T03:40:45.530928+0000","last_unstale":"2024-09-16T03:47:46.153229+0000","last_undegraded":"2024-09-16T03:47:46.153229+0000","last_fullsized":"2024-09-16T03:47:46.153229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212696,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":303480,"num_read_kb":19422657,"num_write":4353,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6186,"num_bytes_recovered":6486491136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6186},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"22'4368","reported_seq":308836,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151302+0000","last_change":"2024-09-16T03:40:45.676915+0000","last_active":"2024-09-16T03:47:46.151302+0000","last_peered":"2024-09-16T03:47:46.151302+0000","last_clean":"2024-09-16T03:47:46.151302+0000","last_became_active":"2024-09-16T03:40:45.676022+0000","last_became_peered":"2024-09-16T03:40:45.676022+0000","last_unstale":"2024-09-16T03:47:46.151302+0000","last_undegraded":"2024-09-16T03:47:46.151302+0000","last_fullsized":"2024-09-16T03:47:46.151302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:42.783608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":304451,"num_read_kb":19484864,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"22'3584","reported_seq":253214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153683+0000","last_change":"2024-09-16T03:40:45.532568+0000","last_active":"2024-09-16T03:47:46.153683+0000","last_peered":"2024-09-16T03:47:46.153683+0000","last_clean":"2024-09-16T03:47:46.153683+0000","last_became_active":"2024-09-16T03:40:45.531890+0000","last_became_peered":"2024-09-16T03:40:45.531890+0000","last_unstale":"2024-09-16T03:47:46.153683+0000","last_undegraded":"2024-09-16T03:47:46.153683+0000","last_fullsized":"2024-09-16T03:47:46.153683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3584,"log_dups_size":0,"ondisk_log_size":3584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":249613,"num_read_kb":15975232,"num_write":3584,"num_write_kb":229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'4288","reported_seq":347267,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150491+0000","last_change":"2024-09-16T03:47:46.052369+0000","last_active":"2024-09-16T03:47:46.150491+0000","last_peered":"2024-09-16T03:47:46.150491+0000","last_clean":"2024-09-16T03:47:46.150491+0000","last_became_active":"2024-09-16T03:40:45.530920+0000","last_became_peered":"2024-09-16T03:40:45.530920+0000","last_unstale":"2024-09-16T03:47:46.150491+0000","last_undegraded":"2024-09-16T03:47:46.150491+0000","last_fullsized":"2024-09-16T03:47:46.150491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:44.065834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":300228,"num_read_kb":19214592,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":6448742400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6150},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"22'4576","reported_seq":369291,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153170+0000","last_change":"2024-09-16T03:47:46.152684+0000","last_active":"2024-09-16T03:47:46.153170+0000","last_peered":"2024-09-16T03:47:46.153170+0000","last_clean":"2024-09-16T03:47:46.153170+0000","last_became_active":"2024-09-16T03:40:45.670520+0000","last_became_peered":"2024-09-16T03:40:45.670520+0000","last_unstale":"2024-09-16T03:47:46.153170+0000","last_undegraded":"2024-09-16T03:47:46.153170+0000","last_fullsized":"2024-09-16T03:47:46.153170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":319451,"num_read_kb":20444864,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6523,"num_bytes_recovered":6839861248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6523},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"22'3840","reported_seq":271818,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151426+0000","last_change":"2024-09-16T03:40:45.677440+0000","last_active":"2024-09-16T03:47:46.151426+0000","last_peered":"2024-09-16T03:47:46.151426+0000","last_clean":"2024-09-16T03:47:46.151426+0000","last_became_active":"2024-09-16T03:40:45.676392+0000","last_became_peered":"2024-09-16T03:40:45.676392+0000","last_unstale":"2024-09-16T03:47:46.151426+0000","last_undegraded":"2024-09-16T03:47:46.151426+0000","last_fullsized":"2024-09-16T03:47:46.151426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3840,"log_dups_size":0,"ondisk_log_size":3840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:33.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":267961,"num_read_kb":17149504,"num_write":3840,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:37.028056+0000","last_change":"2024-09-16T03:40:37.061587+0000","last_active":"2024-09-16T03:44:37.028056+0000","last_peered":"2024-09-16T03:44:37.028056+0000","last_clean":"2024-09-16T03:44:37.028056+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:44:37.028056+0000","last_undegraded":"2024-09-16T03:44:37.028056+0000","last_fullsized":"2024-09-16T03:44:37.028056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:31.549139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"22'4192","reported_seq":296331,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153690+0000","last_change":"2024-09-16T03:40:45.529111+0000","last_active":"2024-09-16T03:47:46.153690+0000","last_peered":"2024-09-16T03:47:46.153690+0000","last_clean":"2024-09-16T03:47:46.153690+0000","last_became_active":"2024-09-16T03:40:45.527941+0000","last_became_peered":"2024-09-16T03:40:45.527941+0000","last_unstale":"2024-09-16T03:47:46.153690+0000","last_undegraded":"2024-09-16T03:47:46.153690+0000","last_fullsized":"2024-09-16T03:47:46.153690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4192,"log_dups_size":0,"ondisk_log_size":4192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:45.862447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274726912,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":292122,"num_read_kb":18695808,"num_write":4192,"num_write_kb":268288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:47.974008+0000","last_change":"2024-09-16T03:40:37.945776+0000","last_active":"2024-09-16T03:44:47.974008+0000","last_peered":"2024-09-16T03:44:47.974008+0000","last_clean":"2024-09-16T03:44:47.974008+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:44:47.974008+0000","last_undegraded":"2024-09-16T03:44:47.974008+0000","last_fullsized":"2024-09-16T03:44:47.974008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:52.199157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'4561","reported_seq":322664,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153910+0000","last_change":"2024-09-16T03:40:45.672119+0000","last_active":"2024-09-16T03:47:46.153910+0000","last_peered":"2024-09-16T03:47:46.153910+0000","last_clean":"2024-09-16T03:47:46.153910+0000","last_became_active":"2024-09-16T03:40:45.671114+0000","last_became_peered":"2024-09-16T03:40:45.671114+0000","last_unstale":"2024-09-16T03:47:46.153910+0000","last_undegraded":"2024-09-16T03:47:46.153910+0000","last_fullsized":"2024-09-16T03:47:46.153910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":318086,"num_read_kb":20357504,"num_write":4561,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"17'2","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978665+0000","last_change":"2024-09-16T03:40:36.985871+0000","last_active":"2024-09-16T03:44:46.978665+0000","last_peered":"2024-09-16T03:44:46.978665+0000","last_clean":"2024-09-16T03:44:46.978665+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:44:46.978665+0000","last_undegraded":"2024-09-16T03:44:46.978665+0000","last_fullsized":"2024-09-16T03:44:46.978665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:42.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"22'4160","reported_seq":294744,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151052+0000","last_change":"2024-09-16T03:40:45.671718+0000","last_active":"2024-09-16T03:47:46.151052+0000","last_peered":"2024-09-16T03:47:46.151052+0000","last_clean":"2024-09-16T03:47:46.151052+0000","last_became_active":"2024-09-16T03:40:45.670429+0000","last_became_peered":"2024-09-16T03:40:45.670429+0000","last_unstale":"2024-09-16T03:47:46.151052+0000","last_undegraded":"2024-09-16T03:47:46.151052+0000","last_fullsized":"2024-09-16T03:47:46.151052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:02.362552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290567,"num_read_kb":18596288,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"15'1","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100369+0000","last_change":"2024-09-16T03:40:37.945198+0000","last_active":"2024-09-16T03:44:46.100369+0000","last_peered":"2024-09-16T03:44:46.100369+0000","last_clean":"2024-09-16T03:44:46.100369+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:44:46.100369+0000","last_undegraded":"2024-09-16T03:44:46.100369+0000","last_fullsized":"2024-09-16T03:44:46.100369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'4160","reported_seq":294677,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.154091+0000","last_change":"2024-09-16T03:40:45.672213+0000","last_active":"2024-09-16T03:47:46.154091+0000","last_peered":"2024-09-16T03:47:46.154091+0000","last_clean":"2024-09-16T03:47:46.154091+0000","last_became_active":"2024-09-16T03:40:45.671244+0000","last_became_peered":"2024-09-16T03:40:45.671244+0000","last_unstale":"2024-09-16T03:47:46.154091+0000","last_undegraded":"2024-09-16T03:47:46.154091+0000","last_fullsized":"2024-09-16T03:47:46.154091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:07.784194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290500,"num_read_kb":18592000,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4112","reported_seq":291025,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.151570+0000","last_change":"2024-09-16T03:40:45.536836+0000","last_active":"2024-09-16T03:47:46.151570+0000","last_peered":"2024-09-16T03:47:46.151570+0000","last_clean":"2024-09-16T03:47:46.151570+0000","last_became_active":"2024-09-16T03:40:45.532732+0000","last_became_peered":"2024-09-16T03:40:45.532732+0000","last_unstale":"2024-09-16T03:47:46.151570+0000","last_undegraded":"2024-09-16T03:47:46.151570+0000","last_fullsized":"2024-09-16T03:47:46.151570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4112,"log_dups_size":0,"ondisk_log_size":4112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:15.386280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":286896,"num_read_kb":18361344,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.100398+0000","last_change":"2024-09-16T03:40:37.944709+0000","last_active":"2024-09-16T03:44:46.100398+0000","last_peered":"2024-09-16T03:44:46.100398+0000","last_clean":"2024-09-16T03:44:46.100398+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:44:46.100398+0000","last_undegraded":"2024-09-16T03:44:46.100398+0000","last_fullsized":"2024-09-16T03:44:46.100398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:20.401325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4176","reported_seq":337689,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.153146+0000","last_change":"2024-09-16T03:47:46.132832+0000","last_active":"2024-09-16T03:47:46.153146+0000","last_peered":"2024-09-16T03:47:46.153146+0000","last_clean":"2024-09-16T03:47:46.153146+0000","last_became_active":"2024-09-16T03:40:45.531058+0000","last_became_peered":"2024-09-16T03:40:45.531058+0000","last_unstale":"2024-09-16T03:47:46.153146+0000","last_undegraded":"2024-09-16T03:47:46.153146+0000","last_fullsized":"2024-09-16T03:47:46.153146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":291254,"num_read_kb":18640256,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6071,"num_bytes_recovered":6365904896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6071},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:46.978687+0000","last_change":"2024-09-16T03:40:36.986005+0000","last_active":"2024-09-16T03:44:46.978687+0000","last_peered":"2024-09-16T03:44:46.978687+0000","last_clean":"2024-09-16T03:44:46.978687+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:44:46.978687+0000","last_undegraded":"2024-09-16T03:44:46.978687+0000","last_fullsized":"2024-09-16T03:44:46.978687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:05.914013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"22'3936","reported_seq":278580,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.150080+0000","last_change":"2024-09-16T03:40:45.677252+0000","last_active":"2024-09-16T03:47:46.150080+0000","last_peered":"2024-09-16T03:47:46.150080+0000","last_clean":"2024-09-16T03:47:46.150080+0000","last_became_active":"2024-09-16T03:40:45.676287+0000","last_became_peered":"2024-09-16T03:40:45.676287+0000","last_unstale":"2024-09-16T03:47:46.150080+0000","last_undegraded":"2024-09-16T03:47:46.150080+0000","last_fullsized":"2024-09-16T03:47:46.150080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3936,"log_dups_size":0,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:36.168400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257949696,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":246,"num_whiteouts":0,"num_read":274627,"num_read_kb":17576128,"num_write":3936,"num_write_kb":251904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.035112+0000","last_change":"2024-09-16T03:40:37.061350+0000","last_active":"2024-09-16T03:44:57.035112+0000","last_peered":"2024-09-16T03:44:57.035112+0000","last_clean":"2024-09-16T03:44:57.035112+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:44:57.035112+0000","last_undegraded":"2024-09-16T03:44:57.035112+0000","last_fullsized":"2024-09-16T03:44:57.035112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:32.101938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:44:57.975727+0000","last_change":"2024-09-16T03:40:37.945917+0000","last_active":"2024-09-16T03:44:57.975727+0000","last_peered":"2024-09-16T03:44:57.975727+0000","last_clean":"2024-09-16T03:44:57.975727+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:44:57.975727+0000","last_undegraded":"2024-09-16T03:44:57.975727+0000","last_fullsized":"2024-09-16T03:44:57.975727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:33.949325+0000","last_clean_scrub_stamp":"2024-09-16T03:40:33.949325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:12.859992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"22'3904","reported_seq":317417,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:46.158280+0000","last_change":"2024-09-16T03:47:46.158634+0000","last_active":"2024-09-16T03:47:46.158280+0000","last_peered":"2024-09-16T03:47:46.158280+0000","last_clean":"2024-09-16T03:47:46.158280+0000","last_became_active":"2024-09-16T03:40:45.670556+0000","last_became_peered":"2024-09-16T03:40:45.670556+0000","last_unstale":"2024-09-16T03:47:46.158280+0000","last_undegraded":"2024-09-16T03:47:46.158280+0000","last_fullsized":"2024-09-16T03:47:46.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:40:43.500615+0000","last_clean_scrub_stamp":"2024-09-16T03:40:43.500615+0000","objects_scrubbed":0,"log_size":3904,"log_dups_size":0,"ondisk_log_size":3904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:41:58.644315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":0,"num_read":273062,"num_read_kb":17475968,"num_write":3904,"num_write_kb":249856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5810,"num_bytes_recovered":6092226560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5810},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4330684440,"num_objects":4132,"num_object_clones":0,"num_object_copies":12396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66082,"num_write_kb":4229185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812015616,"data_stored":12992053320,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":0,"internal_metadata":0},"log_size":66082,"ondisk_log_size":66082,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607645,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126348,"kb_used_data":81276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94245492,"statfs":{"total":96636764160,"available":96507383808,"internally_reserved":0,"allocated":83226624,"data_stored":1328673325,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640349,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206476,"kb_used_data":130876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94165364,"statfs":{"total":96636764160,"available":96425332736,"internally_reserved":0,"allocated":134017024,"data_stored":2141254208,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640349,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247820,"kb_used_data":162556,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94124020,"statfs":{"total":96636764160,"available":96382996480,"internally_reserved":0,"allocated":166457344,"data_stored":2660299333,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157580,"kb_used_data":100028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94214260,"statfs":{"total":96636764160,"available":96475402240,"internally_reserved":0,"allocated":102428672,"data_stored":1635840581,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640348,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455504,"kb_used_data":153664,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93916336,"statfs":{"total":96636764160,"available":96170328064,"internally_reserved":0,"allocated":157351936,"data_stored":2514612805,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":1595,"internal_metadata":309066181},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640349,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":165696,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":169672704,"data_stored":2711745088,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169480192,"data_stored":2711683072,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157163520,"data_stored":2514550808,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102240256,"data_stored":1635778584,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":166268928,"data_stored":2660237336,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133824512,"data_stored":2141192192,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83038208,"data_stored":1328611328,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:47:59.012 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.012 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.012 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.012 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.012 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.013 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.014 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.015 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-16T03:40:33.949325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=33, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.015 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T03:40:43.500615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=40, tm_sec=43, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=3, tm_min=47, tm_sec=54, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T03:47:59.015 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T03:48:19.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T03:48:19.322 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T03:48:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T03:48:19.338 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-16T03:48:18.021102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4330684459,"num_objects":4134,"num_object_clones":0,"num_object_copies":12400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66084,"num_write_kb":4229187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70219,"ondisk_log_size":70219,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1448848,"kb_used_data":794096,"kb_used_omap":9,"kb_used_meta":654646,"kb_avail":564782192,"statfs":{"total":579820584960,"available":578336964608,"internally_reserved":0,"allocated":813154304,"data_stored":12992425340,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":9568,"internal_metadata":670358176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003591"},"pg_stats":[{"pgid":"2.f","version":"22'4352","reported_seq":290459,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:01.486802+0000","last_change":"2024-09-16T03:48:01.486865+0000","last_active":"2024-09-16T03:48:01.486802+0000","last_peered":"2024-09-16T03:48:01.486802+0000","last_clean":"2024-09-16T03:48:01.486802+0000","last_became_active":"2024-09-16T03:40:45.671214+0000","last_became_peered":"2024-09-16T03:40:45.671214+0000","last_unstale":"2024-09-16T03:48:01.486802+0000","last_undegraded":"2024-09-16T03:48:01.486802+0000","last_fullsized":"2024-09-16T03:48:01.486802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4352","last_scrub_stamp":"2024-09-16T03:48:01.486711+0000","last_deep_scrub":"22'4352","last_deep_scrub_stamp":"2024-09-16T03:48:01.486711+0000","last_clean_scrub_stamp":"2024-09-16T03:48:01.486711+0000","objects_scrubbed":256,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:11:26.020123+0000","scrub_duration":1147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":286071,"num_read_kb":18308544,"num_write":4096,"num_write_kb":262144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"22'4012","reported_seq":267653,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:58.159363+0000","last_change":"2024-09-16T03:47:58.159418+0000","last_active":"2024-09-16T03:47:58.159363+0000","last_peered":"2024-09-16T03:47:58.159363+0000","last_clean":"2024-09-16T03:47:58.159363+0000","last_became_active":"2024-09-16T03:40:45.670368+0000","last_became_peered":"2024-09-16T03:40:45.670368+0000","last_unstale":"2024-09-16T03:47:58.159363+0000","last_undegraded":"2024-09-16T03:47:58.159363+0000","last_fullsized":"2024-09-16T03:47:58.159363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4012","last_scrub_stamp":"2024-09-16T03:47:58.159269+0000","last_deep_scrub":"22'4012","last_deep_scrub_stamp":"2024-09-16T03:47:58.159269+0000","last_clean_scrub_stamp":"2024-09-16T03:47:58.159269+0000","objects_scrubbed":236,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:33:52.175879+0000","scrub_duration":1043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":263605,"num_read_kb":16870720,"num_write":3776,"num_write_kb":241664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"22'4626","reported_seq":351132,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:00.354401+0000","last_change":"2024-09-16T03:48:00.354514+0000","last_active":"2024-09-16T03:48:00.354401+0000","last_peered":"2024-09-16T03:48:00.354401+0000","last_clean":"2024-09-16T03:48:00.354401+0000","last_became_active":"2024-09-16T03:40:45.530928+0000","last_became_peered":"2024-09-16T03:40:45.530928+0000","last_unstale":"2024-09-16T03:48:00.354401+0000","last_undegraded":"2024-09-16T03:48:00.354401+0000","last_fullsized":"2024-09-16T03:48:00.354401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4626","last_scrub_stamp":"2024-09-16T03:48:00.354325+0000","last_deep_scrub":"22'4626","last_deep_scrub_stamp":"2024-09-16T03:48:00.354325+0000","last_clean_scrub_stamp":"2024-09-16T03:48:00.354325+0000","objects_scrubbed":273,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:10.369563+0000","scrub_duration":1107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212696,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":303480,"num_read_kb":19422657,"num_write":4353,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6186,"num_bytes_recovered":6486491136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6186},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"22'4641","reported_seq":309128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:00.276886+0000","last_change":"2024-09-16T03:48:00.277014+0000","last_active":"2024-09-16T03:48:00.276886+0000","last_peered":"2024-09-16T03:48:00.276886+0000","last_clean":"2024-09-16T03:48:00.276886+0000","last_became_active":"2024-09-16T03:40:45.676022+0000","last_became_peered":"2024-09-16T03:40:45.676022+0000","last_unstale":"2024-09-16T03:48:00.276886+0000","last_undegraded":"2024-09-16T03:48:00.276886+0000","last_fullsized":"2024-09-16T03:48:00.276886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4641","last_scrub_stamp":"2024-09-16T03:48:00.276757+0000","last_deep_scrub":"22'4641","last_deep_scrub_stamp":"2024-09-16T03:48:00.276757+0000","last_clean_scrub_stamp":"2024-09-16T03:48:00.276757+0000","objects_scrubbed":273,"log_size":4641,"log_dups_size":0,"ondisk_log_size":4641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:52.919188+0000","scrub_duration":1203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286261248,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":304451,"num_read_kb":19484864,"num_write":4368,"num_write_kb":279552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"22'3808","reported_seq":253455,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:00.556554+0000","last_change":"2024-09-16T03:48:00.556745+0000","last_active":"2024-09-16T03:48:00.556554+0000","last_peered":"2024-09-16T03:48:00.556554+0000","last_clean":"2024-09-16T03:48:00.556554+0000","last_became_active":"2024-09-16T03:40:45.531890+0000","last_became_peered":"2024-09-16T03:40:45.531890+0000","last_unstale":"2024-09-16T03:48:00.556554+0000","last_undegraded":"2024-09-16T03:48:00.556554+0000","last_fullsized":"2024-09-16T03:48:00.556554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3808","last_scrub_stamp":"2024-09-16T03:48:00.556451+0000","last_deep_scrub":"22'3808","last_deep_scrub_stamp":"2024-09-16T03:48:00.556451+0000","last_clean_scrub_stamp":"2024-09-16T03:48:00.556451+0000","objects_scrubbed":224,"log_size":3808,"log_dups_size":0,"ondisk_log_size":3808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:25.073887+0000","scrub_duration":823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":249613,"num_read_kb":15975232,"num_write":3584,"num_write_kb":229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'4556","reported_seq":347555,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:01.500198+0000","last_change":"2024-09-16T03:48:01.500267+0000","last_active":"2024-09-16T03:48:01.500198+0000","last_peered":"2024-09-16T03:48:01.500198+0000","last_clean":"2024-09-16T03:48:01.500198+0000","last_became_active":"2024-09-16T03:40:45.530920+0000","last_became_peered":"2024-09-16T03:40:45.530920+0000","last_unstale":"2024-09-16T03:48:01.500198+0000","last_undegraded":"2024-09-16T03:48:01.500198+0000","last_fullsized":"2024-09-16T03:48:01.500198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4556","last_scrub_stamp":"2024-09-16T03:48:01.500131+0000","last_deep_scrub":"22'4556","last_deep_scrub_stamp":"2024-09-16T03:48:01.500131+0000","last_clean_scrub_stamp":"2024-09-16T03:48:01.500131+0000","objects_scrubbed":268,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:32.354338+0000","scrub_duration":1223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":300228,"num_read_kb":19214592,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":6448742400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6150},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"22'4862","reported_seq":369597,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:03.362850+0000","last_change":"2024-09-16T03:48:03.362939+0000","last_active":"2024-09-16T03:48:03.362850+0000","last_peered":"2024-09-16T03:48:03.362850+0000","last_clean":"2024-09-16T03:48:03.362850+0000","last_became_active":"2024-09-16T03:40:45.670520+0000","last_became_peered":"2024-09-16T03:40:45.670520+0000","last_unstale":"2024-09-16T03:48:03.362850+0000","last_undegraded":"2024-09-16T03:48:03.362850+0000","last_fullsized":"2024-09-16T03:48:03.362850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4862","last_scrub_stamp":"2024-09-16T03:48:03.362767+0000","last_deep_scrub":"22'4862","last_deep_scrub_stamp":"2024-09-16T03:48:03.362767+0000","last_clean_scrub_stamp":"2024-09-16T03:48:03.362767+0000","objects_scrubbed":286,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:23.007390+0000","scrub_duration":1135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299892736,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":319451,"num_read_kb":20444864,"num_write":4576,"num_write_kb":292864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6523,"num_bytes_recovered":6839861248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6523},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"22'4080","reported_seq":272076,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:04.861358+0000","last_change":"2024-09-16T03:48:04.861495+0000","last_active":"2024-09-16T03:48:04.861358+0000","last_peered":"2024-09-16T03:48:04.861358+0000","last_clean":"2024-09-16T03:48:04.861358+0000","last_became_active":"2024-09-16T03:40:45.676392+0000","last_became_peered":"2024-09-16T03:40:45.676392+0000","last_unstale":"2024-09-16T03:48:04.861358+0000","last_undegraded":"2024-09-16T03:48:04.861358+0000","last_fullsized":"2024-09-16T03:48:04.861358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4080","last_scrub_stamp":"2024-09-16T03:48:04.861216+0000","last_deep_scrub":"22'4080","last_deep_scrub_stamp":"2024-09-16T03:48:04.861216+0000","last_clean_scrub_stamp":"2024-09-16T03:48:04.861216+0000","objects_scrubbed":240,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:40:56.066611+0000","scrub_duration":1075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":267961,"num_read_kb":17149504,"num_write":3840,"num_write_kb":245760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:58.755619+0000","last_change":"2024-09-16T03:47:58.755672+0000","last_active":"2024-09-16T03:47:58.755619+0000","last_peered":"2024-09-16T03:47:58.755619+0000","last_clean":"2024-09-16T03:47:58.755619+0000","last_became_active":"2024-09-16T03:40:35.673003+0000","last_became_peered":"2024-09-16T03:40:35.673003+0000","last_unstale":"2024-09-16T03:47:58.755619+0000","last_undegraded":"2024-09-16T03:47:58.755619+0000","last_fullsized":"2024-09-16T03:47:58.755619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:47:58.755439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:47:58.755439+0000","last_clean_scrub_stamp":"2024-09-16T03:47:58.755439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:46.142291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090953200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"22'4454","reported_seq":296612,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:02.169605+0000","last_change":"2024-09-16T03:48:02.169683+0000","last_active":"2024-09-16T03:48:02.169605+0000","last_peered":"2024-09-16T03:48:02.169605+0000","last_clean":"2024-09-16T03:48:02.169605+0000","last_became_active":"2024-09-16T03:40:45.527941+0000","last_became_peered":"2024-09-16T03:40:45.527941+0000","last_unstale":"2024-09-16T03:48:02.169605+0000","last_undegraded":"2024-09-16T03:48:02.169605+0000","last_fullsized":"2024-09-16T03:48:02.169605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4454","last_scrub_stamp":"2024-09-16T03:48:02.169520+0000","last_deep_scrub":"22'4454","last_deep_scrub_stamp":"2024-09-16T03:48:02.169520+0000","last_clean_scrub_stamp":"2024-09-16T03:48:02.169520+0000","objects_scrubbed":262,"log_size":4454,"log_dups_size":0,"ondisk_log_size":4454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:47.813006+0000","scrub_duration":1071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274726912,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":0,"num_read":292122,"num_read_kb":18695808,"num_write":4192,"num_write_kb":268288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:00.113376+0000","last_change":"2024-09-16T03:48:00.113414+0000","last_active":"2024-09-16T03:48:00.113376+0000","last_peered":"2024-09-16T03:48:00.113376+0000","last_clean":"2024-09-16T03:48:00.113376+0000","last_became_active":"2024-09-16T03:40:35.672624+0000","last_became_peered":"2024-09-16T03:40:35.672624+0000","last_unstale":"2024-09-16T03:48:00.113376+0000","last_undegraded":"2024-09-16T03:48:00.113376+0000","last_fullsized":"2024-09-16T03:48:00.113376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:48:00.113263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:48:00.113263+0000","last_clean_scrub_stamp":"2024-09-16T03:48:00.113263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:29.169337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000807407,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'4847","reported_seq":322971,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:03.250830+0000","last_change":"2024-09-16T03:48:03.250925+0000","last_active":"2024-09-16T03:48:03.250830+0000","last_peered":"2024-09-16T03:48:03.250830+0000","last_clean":"2024-09-16T03:48:03.250830+0000","last_became_active":"2024-09-16T03:40:45.671114+0000","last_became_peered":"2024-09-16T03:40:45.671114+0000","last_unstale":"2024-09-16T03:48:03.250830+0000","last_undegraded":"2024-09-16T03:48:03.250830+0000","last_fullsized":"2024-09-16T03:48:03.250830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4847","last_scrub_stamp":"2024-09-16T03:48:03.250741+0000","last_deep_scrub":"22'4847","last_deep_scrub_stamp":"2024-09-16T03:48:03.250741+0000","last_clean_scrub_stamp":"2024-09-16T03:48:03.250741+0000","objects_scrubbed":286,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:06.801066+0000","scrub_duration":1143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298909696,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":318086,"num_read_kb":20357504,"num_write":4561,"num_write_kb":291904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"22'3","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:59.346557+0000","last_change":"2024-09-16T03:47:59.346615+0000","last_active":"2024-09-16T03:47:59.346557+0000","last_peered":"2024-09-16T03:47:59.346557+0000","last_clean":"2024-09-16T03:47:59.346557+0000","last_became_active":"2024-09-16T03:40:35.672762+0000","last_became_peered":"2024-09-16T03:40:35.672762+0000","last_unstale":"2024-09-16T03:47:59.346557+0000","last_undegraded":"2024-09-16T03:47:59.346557+0000","last_fullsized":"2024-09-16T03:47:59.346557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-16T03:47:59.346386+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-16T03:47:59.346386+0000","last_clean_scrub_stamp":"2024-09-16T03:47:59.346386+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:31.241019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00079228299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"22'4420","reported_seq":295023,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:58.873784+0000","last_change":"2024-09-16T03:47:58.873835+0000","last_active":"2024-09-16T03:47:58.873784+0000","last_peered":"2024-09-16T03:47:58.873784+0000","last_clean":"2024-09-16T03:47:58.873784+0000","last_became_active":"2024-09-16T03:40:45.670429+0000","last_became_peered":"2024-09-16T03:40:45.670429+0000","last_unstale":"2024-09-16T03:47:58.873784+0000","last_undegraded":"2024-09-16T03:47:58.873784+0000","last_fullsized":"2024-09-16T03:47:58.873784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4420","last_scrub_stamp":"2024-09-16T03:47:58.873714+0000","last_deep_scrub":"22'4420","last_deep_scrub_stamp":"2024-09-16T03:47:58.873714+0000","last_clean_scrub_stamp":"2024-09-16T03:47:58.873714+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:28.561863+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290567,"num_read_kb":18596288,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"22'2","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:58.245627+0000","last_change":"2024-09-16T03:47:58.245652+0000","last_active":"2024-09-16T03:47:58.245627+0000","last_peered":"2024-09-16T03:47:58.245627+0000","last_clean":"2024-09-16T03:47:58.245627+0000","last_became_active":"2024-09-16T03:40:34.972645+0000","last_became_peered":"2024-09-16T03:40:34.972645+0000","last_unstale":"2024-09-16T03:47:58.245627+0000","last_undegraded":"2024-09-16T03:47:58.245627+0000","last_fullsized":"2024-09-16T03:47:58.245627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-16T03:47:58.245566+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-16T03:47:58.245566+0000","last_clean_scrub_stamp":"2024-09-16T03:47:58.245566+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:17.225990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0010221679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"22'4420","reported_seq":294957,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:02.753376+0000","last_change":"2024-09-16T03:48:02.753440+0000","last_active":"2024-09-16T03:48:02.753376+0000","last_peered":"2024-09-16T03:48:02.753376+0000","last_clean":"2024-09-16T03:48:02.753376+0000","last_became_active":"2024-09-16T03:40:45.671244+0000","last_became_peered":"2024-09-16T03:40:45.671244+0000","last_unstale":"2024-09-16T03:48:02.753376+0000","last_undegraded":"2024-09-16T03:48:02.753376+0000","last_fullsized":"2024-09-16T03:48:02.753376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4420","last_scrub_stamp":"2024-09-16T03:48:02.753274+0000","last_deep_scrub":"22'4420","last_deep_scrub_stamp":"2024-09-16T03:48:02.753274+0000","last_clean_scrub_stamp":"2024-09-16T03:48:02.753274+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:32.923674+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":290500,"num_read_kb":18592000,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4369","reported_seq":291301,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:01.883444+0000","last_change":"2024-09-16T03:48:01.883513+0000","last_active":"2024-09-16T03:48:01.883444+0000","last_peered":"2024-09-16T03:48:01.883444+0000","last_clean":"2024-09-16T03:48:01.883444+0000","last_became_active":"2024-09-16T03:40:45.532732+0000","last_became_peered":"2024-09-16T03:40:45.532732+0000","last_unstale":"2024-09-16T03:48:01.883444+0000","last_undegraded":"2024-09-16T03:48:01.883444+0000","last_fullsized":"2024-09-16T03:48:01.883444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4369","last_scrub_stamp":"2024-09-16T03:48:01.883373+0000","last_deep_scrub":"22'4369","last_deep_scrub_stamp":"2024-09-16T03:48:01.883373+0000","last_clean_scrub_stamp":"2024-09-16T03:48:01.883373+0000","objects_scrubbed":257,"log_size":4369,"log_dups_size":0,"ondisk_log_size":4369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:22:30.934287+0000","scrub_duration":1155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269484032,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":286896,"num_read_kb":18361344,"num_write":4112,"num_write_kb":263168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:57.282630+0000","last_change":"2024-09-16T03:47:57.282652+0000","last_active":"2024-09-16T03:47:57.282630+0000","last_peered":"2024-09-16T03:47:57.282630+0000","last_clean":"2024-09-16T03:47:57.282630+0000","last_became_active":"2024-09-16T03:40:34.972743+0000","last_became_peered":"2024-09-16T03:40:34.972743+0000","last_unstale":"2024-09-16T03:47:57.282630+0000","last_undegraded":"2024-09-16T03:47:57.282630+0000","last_fullsized":"2024-09-16T03:47:57.282630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:47:57.282557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:47:57.282557+0000","last_clean_scrub_stamp":"2024-09-16T03:47:57.282557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:25.474357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061686399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'4437","reported_seq":337969,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:02.280403+0000","last_change":"2024-09-16T03:48:02.280482+0000","last_active":"2024-09-16T03:48:02.280403+0000","last_peered":"2024-09-16T03:48:02.280403+0000","last_clean":"2024-09-16T03:48:02.280403+0000","last_became_active":"2024-09-16T03:40:45.531058+0000","last_became_peered":"2024-09-16T03:40:45.531058+0000","last_unstale":"2024-09-16T03:48:02.280403+0000","last_undegraded":"2024-09-16T03:48:02.280403+0000","last_fullsized":"2024-09-16T03:48:02.280403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4437","last_scrub_stamp":"2024-09-16T03:48:02.280304+0000","last_deep_scrub":"22'4437","last_deep_scrub_stamp":"2024-09-16T03:48:02.280304+0000","last_clean_scrub_stamp":"2024-09-16T03:48:02.280304+0000","objects_scrubbed":261,"log_size":4437,"log_dups_size":0,"ondisk_log_size":4437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:24:43.804951+0000","scrub_duration":1035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":291254,"num_read_kb":18640256,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6071,"num_bytes_recovered":6365904896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6071},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:58.322235+0000","last_change":"2024-09-16T03:47:58.322302+0000","last_active":"2024-09-16T03:47:58.322235+0000","last_peered":"2024-09-16T03:47:58.322235+0000","last_clean":"2024-09-16T03:47:58.322235+0000","last_became_active":"2024-09-16T03:40:35.129243+0000","last_became_peered":"2024-09-16T03:40:35.129243+0000","last_unstale":"2024-09-16T03:47:58.322235+0000","last_undegraded":"2024-09-16T03:47:58.322235+0000","last_fullsized":"2024-09-16T03:47:58.322235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:47:58.322057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:47:58.322057+0000","last_clean_scrub_stamp":"2024-09-16T03:47:58.322057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:33:55.520766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088009999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"22'4182","reported_seq":278844,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:03.687586+0000","last_change":"2024-09-16T03:48:03.687698+0000","last_active":"2024-09-16T03:48:03.687586+0000","last_peered":"2024-09-16T03:48:03.687586+0000","last_clean":"2024-09-16T03:48:03.687586+0000","last_became_active":"2024-09-16T03:40:45.676287+0000","last_became_peered":"2024-09-16T03:40:45.676287+0000","last_unstale":"2024-09-16T03:48:03.687586+0000","last_undegraded":"2024-09-16T03:48:03.687586+0000","last_fullsized":"2024-09-16T03:48:03.687586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4182","last_scrub_stamp":"2024-09-16T03:48:03.687473+0000","last_deep_scrub":"22'4182","last_deep_scrub_stamp":"2024-09-16T03:48:03.687473+0000","last_clean_scrub_stamp":"2024-09-16T03:48:03.687473+0000","objects_scrubbed":246,"log_size":4182,"log_dups_size":0,"ondisk_log_size":4182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:19.890835+0000","scrub_duration":919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257949696,"num_objects":246,"num_object_clones":0,"num_object_copies":738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":246,"num_whiteouts":0,"num_read":274627,"num_read_kb":17576128,"num_write":3936,"num_write_kb":251904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:57.826873+0000","last_change":"2024-09-16T03:47:57.826999+0000","last_active":"2024-09-16T03:47:57.826873+0000","last_peered":"2024-09-16T03:47:57.826873+0000","last_clean":"2024-09-16T03:47:57.826873+0000","last_became_active":"2024-09-16T03:40:35.672931+0000","last_became_peered":"2024-09-16T03:40:35.672931+0000","last_unstale":"2024-09-16T03:47:57.826873+0000","last_undegraded":"2024-09-16T03:47:57.826873+0000","last_fullsized":"2024-09-16T03:47:57.826873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:47:57.826619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:47:57.826619+0000","last_clean_scrub_stamp":"2024-09-16T03:47:57.826619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:58.842741+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.00071204999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:47:59.091178+0000","last_change":"2024-09-16T03:47:59.091238+0000","last_active":"2024-09-16T03:47:59.091178+0000","last_peered":"2024-09-16T03:47:59.091178+0000","last_clean":"2024-09-16T03:47:59.091178+0000","last_became_active":"2024-09-16T03:40:35.129262+0000","last_became_peered":"2024-09-16T03:40:35.129262+0000","last_unstale":"2024-09-16T03:47:59.091178+0000","last_undegraded":"2024-09-16T03:47:59.091178+0000","last_fullsized":"2024-09-16T03:47:59.091178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T03:47:59.090974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T03:47:59.090974+0000","last_clean_scrub_stamp":"2024-09-16T03:47:59.090974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:44.582584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00085206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"22'4148","reported_seq":317679,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T03:48:03.979317+0000","last_change":"2024-09-16T03:48:03.979381+0000","last_active":"2024-09-16T03:48:03.979317+0000","last_peered":"2024-09-16T03:48:03.979317+0000","last_clean":"2024-09-16T03:48:03.979317+0000","last_became_active":"2024-09-16T03:40:45.670556+0000","last_became_peered":"2024-09-16T03:40:45.670556+0000","last_unstale":"2024-09-16T03:48:03.979317+0000","last_undegraded":"2024-09-16T03:48:03.979317+0000","last_fullsized":"2024-09-16T03:48:03.979317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4148","last_scrub_stamp":"2024-09-16T03:48:03.979254+0000","last_deep_scrub":"22'4148","last_deep_scrub_stamp":"2024-09-16T03:48:03.979254+0000","last_clean_scrub_stamp":"2024-09-16T03:48:03.979254+0000","objects_scrubbed":244,"log_size":4148,"log_dups_size":0,"ondisk_log_size":4148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:50.610303+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255852544,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":0,"num_read":273062,"num_read_kb":17475968,"num_write":3904,"num_write_kb":249856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5810,"num_bytes_recovered":6092226560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5810},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4330684440,"num_objects":4132,"num_object_clones":0,"num_object_copies":12396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":4611974,"num_read_kb":295166273,"num_write":66082,"num_write_kb":4229185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30740,"num_bytes_recovered":32233226240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30740},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":812015616,"data_stored":12992053320,"data_compressed":62214972,"data_compressed_allocated":812003328,"data_compressed_original":12992053248,"omap_allocated":0,"internal_metadata":0},"log_size":70214,"ondisk_log_size":70214,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":12,"seq":51539607649,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130508,"kb_used_data":81276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241332,"statfs":{"total":96636764160,"available":96503123968,"internally_reserved":0,"allocated":83226624,"data_stored":1328673325,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640353,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198156,"kb_used_data":130876,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94173684,"statfs":{"total":96636764160,"available":96433852416,"internally_reserved":0,"allocated":134017024,"data_stored":2141254208,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640353,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256140,"kb_used_data":162556,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94115700,"statfs":{"total":96636764160,"available":96374476800,"internally_reserved":0,"allocated":166457344,"data_stored":2660299333,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607647,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145100,"kb_used_data":100028,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94226740,"statfs":{"total":96636764160,"available":96488181760,"internally_reserved":0,"allocated":102428672,"data_stored":1635840581,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640352,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":463824,"kb_used_data":153664,"kb_used_omap":1,"kb_used_meta":310142,"kb_avail":93908016,"statfs":{"total":96636764160,"available":96161808384,"internally_reserved":0,"allocated":157351936,"data_stored":2514612805,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":1595,"internal_metadata":317585861},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30740,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640353,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255120,"kb_used_data":165696,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94116720,"statfs":{"total":96636764160,"available":96375521280,"internally_reserved":0,"allocated":169672704,"data_stored":2711745088,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169480192,"data_stored":2711683072,"data_compressed":12985718,"data_compressed_allocated":169480192,"data_compressed_original":2711683072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157163520,"data_stored":2514550808,"data_compressed":12041522,"data_compressed_allocated":157159424,"data_compressed_original":2514550784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102240256,"data_stored":1635778584,"data_compressed":7833450,"data_compressed_allocated":102236160,"data_compressed_original":1635778560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":166268928,"data_stored":2660237336,"data_compressed":12738834,"data_compressed_allocated":166264832,"data_compressed_original":2660237312,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133824512,"data_stored":2141192192,"data_compressed":10253350,"data_compressed_allocated":133824512,"data_compressed_original":2141192192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83038208,"data_stored":1328611328,"data_compressed":6362098,"data_compressed_allocated":83038208,"data_compressed_original":1328611328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T03:48:19.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T03:48:19.638 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T03:48:19.638 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T03:48:19.638 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T03:48:19.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:22.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T03:48:25.741 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T03:48:25.741 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T03:48:25.741 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:25.818 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T03:48:25.819 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T03:48:25.819 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:25.906 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T03:48:25.906 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T03:48:25.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:28.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-16T03:48:28.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T03:48:32.008 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T03:48:32.009 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T03:48:32.009 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:32.089 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T03:48:32.090 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T03:48:32.090 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:32.173 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T03:48:32.174 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T03:48:32.174 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T03:48:32.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:32.203 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T03:48:32.203 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T03:48:32.204 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T03:48:32.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T03:48:32.259 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T03:48:32.260 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T03:48:32.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'missing primary copy of' | egrep -v 'objects unfound and apparently lost' | egrep -v 'had a read error' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(OSD_TOO_MANY_REPAIRS\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-16T03:48:32.346 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:48:32.346 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T03:48:32.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:48:32.610 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T03:48:32.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:48:32.843 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T03:48:32.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:48:32.993 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T03:48:33.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-16T03:48:33.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:48:33.373 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T03:48:33.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:48:33.589 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T03:48:33.746 INFO:tasks.ceph:Archiving mon data... 2024-09-16T03:48:33.748 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/data/mon.a.tgz 2024-09-16T03:48:33.748 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-16T03:48:33.754 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.qLZCUiAMYI 2024-09-16T03:48:33.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qLZCUiAMYI 2024-09-16T03:48:34.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.qLZCUiAMYI 2024-09-16T03:48:34.277 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.qLZCUiAMYI is 2MB 2024-09-16T03:48:34.367 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.qLZCUiAMYI 2024-09-16T03:48:34.374 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T03:48:34.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T03:48:34.417 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T03:48:34.488 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T03:48:34.516 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T03:48:34.516 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T03:48:34.518 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi073/crash 2024-09-16T03:48:34.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T03:48:34.546 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi138/crash 2024-09-16T03:48:34.547 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T03:48:34.593 INFO:tasks.ceph:Compressing logs... 2024-09-16T03:48:34.593 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T03:48:34.596 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T03:48:34.623 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28716.log 2024-09-16T03:48:34.624 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29304.log 2024-09-16T03:48:34.624 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28992.log 2024-09-16T03:48:34.625 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28716.log: /var/log/ceph/ceph-client.admin.29304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28258.log 2024-09-16T03:48:34.625 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28716.log.gz 2024-09-16T03:48:34.625 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29304.log.gz 2024-09-16T03:48:34.626 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28992.log.gz 2024-09-16T03:48:34.626 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25308.log 2024-09-16T03:48:34.627 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28790.log 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28914.log 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25308.log.gz 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28258.log.gz 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28255.log 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28790.log.gz 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28914.log.gz 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28615.log 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28255.log.gz 2024-09-16T03:48:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29200.log 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28067.log 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28615.log.gz 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29200.log.gz 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29096.log 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28192.log 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28067.log.gz 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.29096.log: --verbose -- /var/log/ceph/ceph-client.admin.28764.log 2024-09-16T03:48:34.632 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29096.log.gz 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28192.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28192.log.gz 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28574.log 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28764.log.gz 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29278.log 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28096.log 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28574.log.gz 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28888.log 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29278.log.gz 2024-09-16T03:48:34.633 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28096.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T03:48:34.634 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28096.log.gz 2024-09-16T03:48:34.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28388.log 2024-09-16T03:48:34.634 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28888.log.gz 2024-09-16T03:48:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28421.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.28388.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.28388.log.gz -- 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.25103.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28421.log.gz 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25103.log.gz 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28121.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz /var/log/ceph/ceph-client.admin.28218.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29018.log 2024-09-16T03:48:34.647 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28218.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29070.log 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28262.log 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29018.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28412.log 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29070.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28262.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28412.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28412.log.gz 2024-09-16T03:48:34.648 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28401.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29174.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28401.log.gz 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28420.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29148.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29174.log.gz 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29226.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28420.log.gz 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28616.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29148.log.gz 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.29226.log: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T03:48:34.649 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29226.log.gz 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28616.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28616.log.gz 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28862.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29044.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28940.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28862.log.gz 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29044.log.gz 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25169.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28940.log.gz 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28146.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28556.log 2024-09-16T03:48:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25169.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21527.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25169.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28146.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28249.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28556.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.21527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28166.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21527.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28712.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28249.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28166.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29122.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.28712.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25235.log 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28712.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29122.log.gz 2024-09-16T03:48:34.651 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.25235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28816.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25235.log.gz 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28408.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28263.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28816.log: /var/log/ceph/ceph-client.admin.28408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28816.log.gz 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28408.log.gz 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29252.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28966.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28263.log.gz 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29252.log.gz 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28560.log 2024-09-16T03:48:34.652 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T03:48:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28264.log 2024-09-16T03:48:34.653 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28966.log.gz 2024-09-16T03:48:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28560.log.gz 2024-09-16T03:48:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28264.log.gz 2024-09-16T03:48:34.667 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25119.log 2024-09-16T03:48:34.670 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27783.log 2024-09-16T03:48:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25119.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25119.log.gz -5 2024-09-16T03:48:34.671 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25071.log 2024-09-16T03:48:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27912.log 2024-09-16T03:48:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27783.log.gz 2024-09-16T03:48:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27733.log 2024-09-16T03:48:34.672 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25071.log.gz 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27833.log 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27912.log.gz 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27733.log.gz 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25047.log 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27833.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27833.log.gz 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25047.log.gz 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25095.log 2024-09-16T03:48:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-16T03:48:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25095.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.25095.log.gz /var/log/ceph/ceph-client.0.27857.log 2024-09-16T03:48:34.676 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-16T03:48:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.27881.log 2024-09-16T03:48:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.0.27857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27808.log 2024-09-16T03:48:34.676 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.27857.log.gz 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.27881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27758.log 0.0% 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.27881.log.gz 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27808.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz -- 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr: /var/log/ceph/ceph-client.admin.25023.log 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27937.log 2024-09-16T03:48:34.677 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27758.log.gz 2024-09-16T03:48:34.678 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.25023.log: /var/log/ceph/ceph-osd.4.log 2024-09-16T03:48:34.678 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25023.log.gz 2024-09-16T03:48:34.678 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27937.log.gz 2024-09-16T03:48:34.678 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25143.log 2024-09-16T03:48:34.679 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.25143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25143.log.gz 2024-09-16T03:48:34.705 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T03:48:35.051 INFO:teuthology.orchestra.run.smithi073.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T03:48:36.111 INFO:teuthology.orchestra.run.smithi073.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T03:49:27.029 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T03:51:08.484 INFO:teuthology.orchestra.run.smithi138.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T03:52:21.454 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T03:53:54.681 INFO:teuthology.orchestra.run.smithi138.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T03:53:54.758 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-16T03:53:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:real 5m20.115s 2024-09-16T03:53:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:user 6m15.413s 2024-09-16T03:53:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m17.554s 2024-09-16T03:54:56.495 INFO:teuthology.orchestra.run.smithi073.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T03:57:24.832 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T03:57:24.931 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-16T03:57:24.931 INFO:teuthology.orchestra.run.smithi073.stderr:real 8m50.337s 2024-09-16T03:57:24.931 INFO:teuthology.orchestra.run.smithi073.stderr:user 9m24.899s 2024-09-16T03:57:24.931 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m29.787s 2024-09-16T03:57:24.935 INFO:tasks.ceph:Archiving logs... 2024-09-16T03:57:24.936 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi073/log 2024-09-16T03:57:24.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T03:58:07.568 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi138/log 2024-09-16T03:58:07.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T03:58:38.197 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T03:58:38.206 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T03:58:38.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T03:58:38.209 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T03:58:38.312 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T03:58:38.322 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T03:58:38.323 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:58:38.326 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:58:38.409 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T03:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-16T03:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 67.205.162.81 3 u 53 64 377 0.108 -4.349 1.516 2024-09-16T03:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.076 -3.658 2.909 2024-09-16T03:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.088 -6.122 2.152 2024-09-16T03:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-16T03:58:38.420 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T03:58:38.420 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-16T03:58:38.420 INFO:teuthology.orchestra.run.smithi138.stdout:+hv01.front.sepi 67.205.162.81 3 u 41 64 377 0.083 -3.956 1.087 2024-09-16T03:58:38.420 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 49 64 377 0.114 -6.745 1.276 2024-09-16T03:58:38.421 INFO:teuthology.orchestra.run.smithi138.stdout:*hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.098 -5.385 1.182 2024-09-16T03:58:38.421 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-16T03:58:38.422 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T03:58:38.435 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T03:58:38.435 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T03:58:38.443 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T03:58:38.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T03:58:38.460 INFO:teuthology.task.internal:Duration was 1697.548217 seconds 2024-09-16T03:58:38.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T03:58:38.473 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T03:58:38.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T03:58:38.476 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T03:58:38.721 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T03:58:38.722 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T03:58:38.722 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T03:58:38.744 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-16T03:58:38.744 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T03:58:38.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T03:58:38.768 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T03:58:38.788 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T03:58:38.856 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T03:58:38.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T03:58:38.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T03:58:39.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T03:58:39.049 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T03:58:39.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T03:58:39.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T03:58:39.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T03:58:39.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:58:39.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:58:39.150 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-16T03:58:39.172 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-16T03:58:39.196 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:58:39.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:58:39.215 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:58:39.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:58:39.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T03:58:39.251 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T03:58:39.252 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi073 2024-09-16T03:58:39.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T03:58:39.282 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905892/remote/smithi138 2024-09-16T03:58:39.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T03:58:39.306 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T03:58:39.306 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T03:58:39.320 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T03:58:39.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T03:58:39.361 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T03:58:39.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T03:58:39.370 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T03:58:39.370 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T03:58:39.373 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T03:58:39.377 INFO:teuthology.orchestra.run.smithi073.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 03:58 /home/ubuntu/cephtest 2024-09-16T03:58:39.399 INFO:teuthology.orchestra.run.smithi138.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 03:58 /home/ubuntu/cephtest 2024-09-16T03:58:39.400 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T03:58:39.409 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T03:58:39.431 INFO:teuthology.run:Summary data: description: rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} duration: 1697.5482172966003 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T03:58:39.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T03:58:39.508 INFO:teuthology.run:pass